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FOREWORD 


This  study  involves  the  evaluation  of  quantitative  techniques  to  Improve 
subsistence  demand  forecasting  in  the  Defense  Logistics  Agency.  A  wide 
variety  of  techniques  were  tested  for  approximately  A, 000  Item/warehouse  demand 
series  over  the  1977-1983  time  frame. 

The  range  of  forecasting  teclmlques  analyzed  Included  the  following: 
autoregressions,  autoregressions  with  seasonal  terms:  simple  moving  averages; 
single,  double,  adaptive  .and  combined  exponential  smoothing;  naive  and  the 
current  DLA  methods.  The  methodology,  in  effect,  substituted  Individual 
and/or  groups  of  methods  for  the  DLA  method  to  compute  forecasts  over  the  1980- 
1983  period. 

Findings  Indicated  that  about  20Z  more  variability  In  lead  time  demand  was 
Incurred  during  the  1980-1983  time  period  than  achieved  by  a  group  of  five 
methods  Identified  In  this  study,  during  that  period.  Similarly,  lAZ  more 
variability  In  procurement  cycle  demand  forecast  error  was  Incurred  during  the 
1980-1983  time  period. 

Procedures  are  Identified  that  can  achieve  further  substantial  reductions  in 
variability  of  lead  time  desutnd  through  the  use  of  forecast  adjustments.  A 
prototype  subsistence  demand  forecasting  system  is  described  based  on  the 
recoaBended  group  of  models  in  this  study.  This  study  also  serves  as  the 
analytical  basis  for  the  development  of  the  functional  description  for  the 
Forecastlxig  Hodule  of  Defense  Integrated  Subsistence  Management  System  (DISMS). 

Volume  I  contains  the  body  of  the  study  report,  while  Volume  II  provides 
amplifying  details  in  appendices. 

The  effort  documented  herein  was  a  study;  Its  findings  and  conclusions  reflect 
the  data  at  the  time  the  study  was  conducted  and  sht^d  not  be  construed  as  the 
official  position  of  the  Defense  Loglhtlcs  Ageni^  / 
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Executive  Summary 


One  of  Che  primary  missions  of  DLA  is  to  provide  supplies  for  hundreds  of 
thousands  of  lines  of  Inventory  Co  customers  In  the  Ililltary  Services,  other 
Federal  Agencies,  and  friendly  foreign  governments.  Among  chose  supplies  Is 
food  or  subsistence  supplies.  Paramount  to  the  proper  execution  of  the  supply 
mission  Is  Che  decision  of  when  and  how  much  to  buy  for  replenishment  of  the 
DLA  Inventory  In  anticipation  of  customer  demand.  The  validity  of  that 
decision  depends  on  Che  Agency's  ability  to  forecast  customer  demand. 

Forecasting  can  either  be  qualitative  or  quantitative.  Quantitative 
forecasting  Is  the  subject  of  this  report.  The  techniques  of  quantitative 
forecasting  begin  with  past  data  values  and,  following  a  systematic  procedure, 
develop  a  prediction  of  future  data  values.  The  Defense  Logistics  Agency 
(DLA)  uses  quantitative  forecasting  to  predict  customer  demand. 

In  1980,  DLA  embarked  on  an  effort  to  Improve  demand  forecasting  for  Che 
Subsistence  commodity.  this  study  concludes  the  analysis  portion  of  that 
effort.  The  objective  of  the  study  was  to  Investigate  techniques  for  Improving 
demand  forecasts  over  lead  times  and  procurement  cycles. 

In  Inventory  management,  the  lead  time  Is  Che  length  of  time  between  the 
decision  to  replenish  ttw  item  and  the  actual  addition  of  Its  order  quantity  to 
the  Inventory.  The  procurement  cycle  Is  the  length  of  time  between  successive 
buys.  Safety  levels  represent  extra  Inventory  held  as  buffers  against  errors 
in  demand  and  lead  time  forecasts.  Demand  forecasting  links  actual  customer 
requirements  and  ordering  habits  (outside  DLA's  control)  to  these  Inventory 
levels  held  In  anticipation  of  customer  demand  (within  DLA's  control). 

Consequently,  DLA's  ability  to  accurately  forecast  demand  or  sales  directly 
Impacts  on  Its  mission  performance.  Specifically,  Improved  forecasting  will 
result  In  the  following: 

o  Improved  customer  service  by  enhancing  management's  ability  to  order 
the  proper  quantity  of  the  right  Items  at  the  right  time. 

o  Reduced  safety  stocks  required  to  meet  customer  requirements.  (DLA 
presently  maintains  safety  stocks  of  $95  million  (end  FY  84)  for 
Subsistence.) 

o  Reduced  risk  of  acquiring  Items  In  "long  supply,"  less  waste, 
merchandising  stock  at  less  than  cost  and  other  associated  inventory  costs. 

On  the  other  hand.  Inadequate  forecasting  results  in  the  following: 

o  Increased  management  effort  required  to  meet  customer  requirements. 

o  Increased  operational  costs  due  to  spot  buying  and  higher  stock  levels. 


o  Increased  risks  of  acquiring  long  supplies  of  materiel  and  the 
subsequent  resource  expenditures  needed  to  manage  the  materiel . 


Presently,  DLA  does  not  have  perfect  Information  on  the  factors  that  drive 
customer  demands.  Wide  swings  in  demand  due  to  special  customer  requirements 


can  not  be  predicted  by  quantitative  forecasting.  However,  quantitative 


XV 


forecasting  can  be  employed  to  minimize  the  variation  between  forecasted  and 
actual  demands  of  a  recurring  nature. 

As  stated  before,  the  purpose  of  this  study  was  to  evaluate  and  test 
quantitative  forecasting  techniques  to  better  plan  for  the  replenishment  of 
inventories  for  the  Subsistence  commodity.  A  primary  reason  for  the  initiation 
of  the  study  is  the  existence  of  seasonal  demand  patterns  in  the  subsistence 
commodity.  Seasonal  patterns  occur  when  demand  fluctuates  in  a  similar  way 
within  a  certain  period  (annually,  quarterly,  etc).  Seasonality  is  not 
considered  under  present  subsistence  forecasting  methods.  About  1  out  of  7 
subsistence  lead  time  demand  series  exhibit  a  seasonal  pattern. 

The  approach  to  this  study  involved  the  following  steps: 

•  Structuring  historical  demand  data  for  the  purpose  of  forecasting. 

•  Fitting  various  forecasting  models  based  on  1978-1979  demand  data. 

•  Evaluating  those  models  based  on  the  forecasted  vs.  actual  demand  for 
1980  -  1983  demand  data. 

•  Selecting  the  best  individual  model  and  or  group  of  models  for  possible 
implementation . 

e  Testing  methods  to  track  forecast  errors  so  that  the  models  can  be 
switched  within  the  group.  This  is  necessary  when  the  assigned  model  no 
longer  is  tracking  the  demand  pattern. 

Analytical  efforts  of  this  study  involved  processing  7,850  subsistence  demand 
series  through  more  than  100  forecasting  models.  Complete  documentation  and 
explanation  of  tested  forecasted  models  are  included  in  the  main  study  report. 

The  key  findings  of  this  study  are  as  follows: 

e  Over  the  1980  -  1983  time  frame,  the  standard  deviation  of  lead  time 
demand  derived  from  the  current  OLA  forecast  model  was  20Z  larger  than  the 
standard  deviation  of  lead  tlsw  demand  derived  from  a  group  of  five 
alternative  models. 

e  The  group  of  five  models  Includes  two  seasonal  models  which  would 
provide  the  capability  to  forecast  seasonal  demands  within  the  subsistence 
commodity. 

e  A  new  tracking  signal  was  identified  which  responds  more  effectively  to 
demand  variation  and  provides  the  criterion  for  forecast  model  selection 
within  the  group. 

•  The  recommended  model  group  can  be  implemented  as  the  Demand 
Forecasting  Module  for  Management  Requirements  Determination  under  the 
new  Defense  Integrated  Subsistence  Management  System  (DISMS).  The  Demand 
Forecasting  Module  provides  DISHS  with  the  capability  to  develop, 
evaluate,  compare,  and  control  demand  forecasts  for  the  subsistence 
commodity. 


Based  on  these  findings,  the  Executive  Director  for  the  Directorate  of  Supply 
Operations  should  develop  an  implementation  plan  to  incorporate  the  prototype 
forecasting  system  in  this  report  into  a  Forecasting  System  Module  for 
Management  Requirements  Determination  under  DISMS.  The  implementation  costs 
are  small  when  considered  against  the  benefits  gained.  Specifically,  these 
benefits  include: 

•  Less  safety  stock  to  meet  customer  requirements. 

•  Reduced  need  for  "crisis"  management  due  to  stockouts. 

•  Improved  customer  satisfaction. 

•  Less  merchandizing  of  short  shelf-life  materiel. 

In  summary,  DLA  relies  on  customer  requirements  to  schedule  the  timing  and 
quantity  of  buys.  For  the  subsistence  commodity,  seasonal  patterns  occur  In 
14Z  of  Item  lead  time  demand  distributions.  Significant  reductions  In 
subsistence  demand  variation  can  be  achieved  through  the  replacement  of  present 
subsistence  forecasting  methods.  The  recommended  model  group  can  be  expected 
to  provide  around  20Z  better  lead  time  demand  forecasts  than  existing  methods. 
Moreover,  the  recommended  tracking  signal  will  provide  more  responsive  warnings 
to  management  when  demand  patterns  change.  The  application  of  quantitative 
forecasting  techniques  to  the  subsistence  commodity,  while  not  a  panacea,  can 
significantly  Improve  the  Inventory  management  of  that  commodity.  The 

Implementation  of  these  techniques  In  a  Forecasting  System  Module  serves  as  a 
major  step  toward  the  future  In  the  development  of  the  new  Subsistence 
Requirements  Determination  System. 
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I. 


INTRODUCTION 


A.  Background 

1.  What  is  Forecasting.  Forecasting  Is  the  prediction  or  estimation 

of  future  events  and  is  an  Invaluable  component  of  business  planning. 

Effective  planning  sets  goals  and  objectives  for  an  organization  and  the 
strategies  to  attain  these  goals.  Forecasting  provides  the  benchmarks  by  which 
plans  and  policies  can  be  developed  to  respond  to  future  opportunities  and 

problems.  In  business,  better  forecasts  are  needed  since  decisions  usually 

involve  dollars  and  the  successful  performance  of  a  mission. 

2.  Specific  Tasking.  One  of  the  primary  missions  of  DLA  is  to 

provide  supplies  for  hundreds  of  thousands  of  lines  of  Inventory  to  customers 
in  the  Military  Services,  other  Federal  Agencies,  and  friendly  foreign 
governments.  Among  those  supplies  is  food  or  subsistence  supplies.  Paramount 
to  the  proper  execution  of  the  supply  mission  is  the  decision  of  when  and  how 
much  to  buy  for  replenishment  of  the  DLA  inventory  in  anticipation  of  customer 
demand.  The  validity  of  that  decision  depends  on  the  Agency's,  ability  to 

forecast  customer  demand. 

Forecasting  can  either  be  qualitative  or  quantitative.  The  selection  of  a 
qualitative  or  quantitative  technique  depends  on  the  specific  application  as 
well  as  on  the  Information  available  to  formulate  a  forecast. 

Qualitative  forecasting  is  best  suited  to  those  situations  in  which  historical 
data  is  not  readily  available  or  applicable  and  in  %rtilch  judgement  must  be 
heavily  relied  upon.  It  is  used  to  forecast  changes  in  processes  which  may  be 
the  result  of  exogenous  influences.  Qualitative  techniques  are  often  applied 
only  to  long  term  situations  due  to  their  dependence  on  expert  Judgement  and 
subjectivity. 

Quantitative  forecasting  is  the  subject  of  this  report.  The  techniques  of 
quantitative  forecasting  begin  with  past  data  values  and,  following  a 
systematic  procedure,  develop  a  prediction  of  future  data  values.  With  the 
onset  of  computers,  application  of  quantitative  forecasting  has  become 
widespread.  Quantitative  techniques  have  a  track  record  of  better  accuracy  and 
lower  cost,  and  are  generally  accepted  over  qualitative  techniques.  Many 
quantitative  techniques  have  been  developed  and  applied  by  Government  and 
industry  to  uncover  the  basic  patterns  of  historical  data  in  order  to  develop 
forecasts.  Monitoring  methods  which  send  a  signal  to  management  when  these 
patterns  change  are  critical  to  the  application  of  quantitative  forecasting. 

In  1980,  the  DLA  Operations  Research  and  Economic  Analysis  Office  (DLA-LO)  was 
tasked  to  discover  what  forecasting  techniques  should  be  applied  for 
subsistence  items.  As  a  substantial  number  of  subsistence  items  possess 
seasonal  demand  patterns,  various  forecasting  methods  not  presently  used  by  DLA 
had  to  be  investigated.  An  objective  of  the  tasking  was  to  identify  those 
item/demand  characteristics  that  result  in  the  assignment  of  a  specific 
forecasting  technique  for  established  items.  Based  on  this  assignment, 
decision  rules  for  assigning  forecasting  techniques  to  new  items  could  be 
established.  After  initial  review  of  the  problem,  the  Defense  Logistics  Agency 
(DLA)  contracted  with  Inductive  Inference,  Incorporated,  to  Identify  and  test 
new  techniques  for  a  small  sample  of  subsistence  items.  The  test  was 
successful  and  a  report  documenting  the  results  was  provided  in  October  1982 
(Reference  13). 


The  DLA  is  currently  implementing  a  plan  for  the  worldwide  integrated 
management  of  wholesale  subsistence  stocks.  The  Defense  Personnel  Support 
Center  (DPSC) ,  a  primary  level  field  activity  of  DLA,  is  the  inventory  control 
point  for  the  subsistence  commodity.  The  Defense  Integrated  Subsistence 
Management  System  (DISMS)  encompasses  all  automated  information  systems  that 
support  subsistence  management.  As  such,  the  design  quality  and  integration  of 
DISMS  is  critical  for  the  success  of  this  plan.  -  Moreover,  demand  forecasting 
is  a  primary  component  in  the  management  requirements  determination  process 
under  DISMS. 

In  March  1983,  the  OISMS  task  group  delivered  the  final  Management  Requirement 
for  Forecasting  which  Included  the  results  of  the  contracted  test.  The 
DISMS  Management  Requirement  for  Forecasting  demonstrated  that  better 
forecasting  can  be  achieved  through  the  decomposition  of  demand  patterns  into 
trend,  seasonal,  and  random  components.  Also  it  was  found  that  forecasting  the 
lead  time  demand  was  better  than  developing  a  forecast  based  on  a  monthly 
forecast  spread  over  the  lead  time. 

DLA  awarded  a  second  contract  to  Inductive  Inference,  Incorporated  in  late 
1983  to  extend  the  techniques  used  in  the  first  contract  to  the  entire 
subsistence  commodity  and  to  Identify  patterns  in  Item/demand/model 
assignment . 

Due  to  the  large  volume  of  work  involved  and  liiblted  contract  funding,  DLA-LO 
employed  a  team  approach  with  the  contractor  and  DISMS  task  group  and  extensive 
support  staff. 

B.  Statement  of  Problem.  The  demand  forecasting  techniques  presently 
used  by  DPSC  attempt  to  accurately  track  the  underlying  demand  patterns  for 
subsistence  items.  However,  numerous  statistical  factors  and  policy  influences 
exist  that  affect  there  patterns  and  complicate  tracking.  They  are  as  follows: 

1.  Policy  Influences  -  Created  by  management  to  enhance  customer 
support  or  reduce  cost,  they  include  such  actions  as  spot  buys, 
promotional  sales,  item  substitution,  etc. 

2.  Statistical  Factors  - 

a.  Average  Level  -  The  underlying  horizontal  demand  pattern 
which  does  not  tend  to  Increase  or  decrease  in  a  systematic  way. 

b.  Trend  -  The  rate  of  growth  or  reduction  in  the  average  level 
of  demand  that  is  occurring  from  period  to  period. 

c.  Seasonality  -  Generally,  recurring  patterns  at  certain 
Interval  as  a  consequence  of  time  of  year.  Examples  are  holiday 
items,  ice  cream,  sparerlbs,  cocoa,  etc. 

d.  Cycle  -  Long-term  (3-10  years)  factors  generally  affecting 
the  entire  economy,  heavily  Influenced  by  Government  decisions 
and  world  politics. 

e .  Randomness  -  Represents  all  Influences  not  Included  in 
level,  trend,  seasonality,  and  cycles.  Includes  such  things  as 
sampling  error,  acts  of  God,  etc. 

The  problem  is  to  Identify  forecasting  methods  which  more  accurately  track 


demand  In  light  of  these  policy  Influences  and  statistical  factors. 


C.  Objectives 


The  objectives  of  this  study  are: 

1.  To  develop  a  prototype  forecasting  system  to  test  and  evaluate  a 
variety  of  forecasting  methods  for  the  subsistence  commodity. 

2.  To  develop  a  set  of  decision  rules  to  assign  forecasting  methods 
to  new  items  in  the  subsistence  inventory. 

D.  Scope 

1 .  Project  Effort.  This  study  addresses  a  large  scale  test  and 
evaluation  of  quantitative  techniques  for  forecasting  item/ warehouse  demands 
within  the  subsistence  commodity.  New  techniques  were  identified  that 
significantly  reduce  the  forecast  error  and  bias  encountered  with  presently 
used  methods.  It  is  the  intent  of  the  authors  that  the  methodology,  findings, 
and  conclusion  of  this  study  provide  a  first  step  towards  the  implementation  of 
improved  forecasting  in  DLA  automated  materiel  management  systems. 

The  study  was  limited  in  the  follo%ring  manner: 

1 .  Monthly  demand  for  stocked  items  at  each  subsistence  wholesale 
depot  for  the  period  July  1977  -  November  1983  (77  months)  were 
extracted  from  the  Defense  Personnel  Support  Center  (DPSC) 
files. 

2.  Each  stocked  Item  experiencing  48  months  of  nonzero  demand  for 
the  period  September  1979  -  August  1983  was  screened  for  further 
analysis  (3,925  item/ warehouse  records). 

3.  Existing  software  developed  under  the  previous  contract  study 
with  Inductive  Inference,  Incorporated,  was  upgraded  to  increase  its 
flexibility  and  power. 

4.  To  provide  management  with  information  to  assist  in  the  decision 
of  when  and  how  much  to  buy,  lead  time  demand  forecasts  and  demand 
forecasts  for  the  procurement  cycle  following  the  lead  time  were 
generated.  No  aggregation  above  the  item/ depot  level  was  made. 

5.  Software  was  developed  to  augment  forecast  model  Identifications 
and  estimations,  to  test  model  assignments  to  classes  of  items,  and 
to  evaluate  forecast  adequacy  across  the  entire  class  of  models.  A 
group  of  models  were  recommended  for  final  analysis  and  implemen¬ 
tation. 

An  assumption  of  the  study  was  that  one  hundred  percent  (lOOZ)  of  nonrecurring 
demand  for  perishable  items  was  included  with  recurring  demand  for  forecasting 
at  the  wholesale  level. 


2.  Report  Organization  The  two  volumes  of  this  report  document  the 
work  performed  by  the  study  team.  Volume  I,  the  Study  Report,  presents  a 
general  review  of  the  study  assignment,  methodology,  analysis,  findings,  and 
recommendations.  Volume  II  addresses  specific  details  about  forecast  model 
assignments  for  the  subsistence  commodity  and  the  description  of  model 
formulas. 

Section  II  of  Volume  I  describes  the  current  Subsistence  commodity.  The  reader 
who  has  a  general  knowledge  of  the  management  subsistence  may  wish  to  bypass 
Part  A,  An  Overview,  and  go  directly  to  Part  B;  Demand  Forecasting.  The  reader 
who  has  a  comprehensive  knowledge  of  subsistence  and  the  role  of  demand 
forecasting  may  elected  to  skip  Section  II  In  Its  entirety. 

II.  THE  SUBSISTENCE  COMMODITY 

A.  An  Overview 

The  availability  of  wholesome  and  popular  food  and  foodstuffs  (known  as 
subsistence)  both  on  the  mess  hall  table  and  on  the  commissary  shelf  Is 
critical  to  the  health  and  morale  of  the  U.S.  Forces  and  their  families.  DLA 
has  the  mission  to  provide  high  quality  subsistence  to  the  Military  Services, 
some  Federal  agencies,  and  authorized  foreign  governments. 

1.  Subsistence  Categories 

The  subsistence  commodity  management  is  presently  split  Into  two  categories: 
perishable  and  semi perishable.  Perishable  subsistence  Includes  nonstocked 
Items  such  as  fresh  fruits  and  vegetables,  bread  and  milk  and  stocked  items 
that  require  chilling  or  freezing.  Semi perishable  subsistence  includes  items 
that  do  not  require  chilling  or  freezing  such  as  canned  goods.  Within  the 
categories  of  perishable  and  semi perishable  subsistence,  items  are  classified 
as  (1)  troop  issue  -  those  generally  Intended  for  troop  feeding  and,  to  a  minor 
extent,  for  commissary  resale;  and  (2)  brand  name,  those  generally  intended  for 
commissary  resale  and,  to  a  minor  extent,  for  troop  feeding.  Brand  name  items 
are  characterized  by  an  alphabetic  character  in  the  seventh  digit  of  the  stock 
number . 

Table  1  shows  the  primary  federal  supply  classes  (FSCs)  that  are  managed  under 
the  subsistence  commodity.  Table  1  does  not  contain  the  FSCs  for  minor  super¬ 
market  brand  name  semlperlshable  items,  similar  to  convenience  store  items, 
such  as  flyswatters,  brooms,  light  bulbs,  etc.  However,  these  items  are 
stocked  in  the  supply  system  and  are  included  in  this  study. 


The  great  oiajorlty  of  subsistence  items  occur  in  the  following  federal  supply 
classes  (FSCs): 


Table  1 


I 


FEDERAL  SUPPLY  CLASSES  FOR  SUBSISTENCE 


1“ 

FSC 

Title 

8905 

Meat,  Poultry,  and  Fish 

8910 

Dairy  Foods  and  Eggs 

8915 

Fruits  and  Vegetables 

8920 

Bakery  and  Cereal  Products 

8925 

Sugar,  Confectionary  and  Nuts 

8930 

Jams,  Jellies  and  Preserves 

8935 

Soups  and  Bouillons 

8940 

Special  Dietary  Foods  and  Food 

Specialty  Preparations 

8945 

Foods,  Oils  and  Fats 

8950 

Condiments  and  Related  Products 

8955 

Coffee,  Tea  and  Cocoa 

8960 

Beverages,  Nonalcoholic 

8965 

Beverages,  Alcoholic 

8970 

Composite  Food  Packages 

8975 

Tobacco  Products 

2.  Mission 

The  alsslon  of  subsistence  commodity  management  within  DLA  Is  executed  by 
DFSC's  Subsistence  Directorate  (DFSC-S)  through  Subsistence  Field  Activities  in 
CONUS  and  overseas,  with  support  from  certain  Defense  Depots,  Military  Service 
Activities,  and  Worldwide  Integrated  Management  of  Wholesale  Subsistence  Stock 
(WINS)  agents. 

The  customers  for  subsistence  are  mess  halls  and  other  base  installations,  and 
commissaries  from  which  the  items  are  resold  to  authorized  buyers. 

3.  Special  Characteristics.  Some  characteristics  of  the  subsistence 
commodity  which,  in  total,  make  it  different  from  other  commodities  managed  by 
DLA,  are  as  follows: 

a.  Shelf  Life  Limitations.  Useful  life  may  be  short  and  Is 
variable;  affected  by  handling  and  distribution. 

b.  Storage  and  Transportation.  Refrigeration  is  required  for 
many  items;  humidity  must  be  controlled;  piling  is  limited  as  is 
product  mixing;  high  transportation  per  unit  costs. 

c.  Product  Utilization.  "Fill  or  kill"  requisition  policy;  low 
unit  costs;  high  morale  factor. 

d.  Product  Availability.  Depot  shipment  vs.  direct  vendor 
delivery  vs.  local  purchase;  seasonality  of  demand. 


For  morale  and  health  purposes,  it  is  necessary  to  provide  a  wide  variety  of 
subsistence  products  to  the  customer  on  demand. 


4.  Automated  Materiel  Management  Systems 

The  DPSC  uses  three  different  automated  systems  to  assist  managers  in  providing 
logistics  support  to  customers  throughout  the  world.  The  Perishable 
Subsistence  Automated  Supply  System  (PSASS)  is  used  to  compute  requirements, 
buy  actions,  and  safety  levels  for  perishable  troop  issue  and  brand  name  items 
overseas  and  perishable  troop  issue  items  in  CONUS. 

The  Semlperlshable  Central  Stocked  System  computes  requirements,  buy  actions, 
and  safety  levels  for  semi perishable  troop  issue  and  brand  name  items  overseas 
and  semlperlshable  troop  issue  in  CONUS. 

The  Direct  Commissary  Support  System  (DICOMSS)  is  used  to  provide  direct  supply 
support  services  for  bra^  name  items  and  items  restricted  to  large  commissary 
customers  overseas  but  not  '.supplied  in  CONUS.  Within  PSASS  and  the  Central 
System,  demand  forecasts  are  generated  which  drive  the  timing  and  quantity  of 
buys.  Residual  Stocks  from  DICOMMS  shipments  are  held  in  the  depots  for  future 
issue. 

Further  detail  and  illustrations  on  these  management  systems  and  subsistence 
requisition  processing  are  provided  in  Appendix  A. 

B.  Demand  Forecasting 

1.  Demand  Accumulation 

DPSC  stocks  certain  classes  of  items  at  the  various  depots  to  account  for 
inaccuracy  in  demand  forecasting,  delayed  contract  deliveries,  etc.  Customer 
demands  are  supported  either  from  storage  or  by  direct  vendor  delivery. 
Demands  which  are  less  than  a  carlot  are  supported  from  depot  stock  and  are 
used  to  generate  forecasts.  Customer  demands  that  can  be  met  with  carlot 
shipments  are  supported  by  direct  vendor  delivery  and  are  not  used  In  demand 
forecasting. 

In  the  semlperlshable  Item  Central  Stock  System,  both  recurring  and  100  percent 
of  nonrecurring  demand  are  used  in  demand  forecasting.  In  PSASS,  only 
recurring  demand  la  used.  When  a  customer  subislts  a  recurring  requisition  for 
an  item  out  of  stock,  the  requisition  is  killed  but  the  demand  is  stored.  The 
demand  forecasts  used  to  develop  stockage  levels  at  the  various  depots  are  the 
subject  of  this  section  of  the  report. 

2.  Demand  Forecast  Computations.  Monthly  demand  forecasts  are 
computed  for  each  location/type  pack,  as  follows: 

a.  For  both  perishable  chill  and  freeze  items  overseas  and 
selected  CONUS  Items,  a  three-month  weighted  average  is  calculated  by  adding 
two-thirds  of  the  current  month's  demand  to  one-sixth  of  each  of  the  past  two 
months'  demands.  This  is  equivalent  to  a  simple  4-1-1  moving  average  (known  as 
the  D-forecast). 


Officially,  for  CONUS  locations,  purchases  are  made  only  for  open  funded 
requisitions  for  the  past  and  current  months  (R-forecast)  on  the  requisition 
status  file.  However,  because  other  requisitions  with  short  lead  times  may  be 
received  after  the  purchase  is  Initiated,  the  4-1-1  forecast  is  also  applied 
for  COIHJS  purchases  and  for  safety  level  computations.  General  lack  of 
confidence  in  both  of  these  methods  has  led  to  item  managers  examining  recent 
trends  and  this  month's  demand  at  the  same  time  last  year  to  estimate  lead 
time  demand,  especially  for  brand  name  items. 

b.  Semlperlshable  subsistence  is  forecasted  using  single 
exponential  smoothing  with  trend  correction  (modified  double  exponential 
smoothing).  (See  Appendix  A  for  further  discussion  of  the  exponential 
smooching  techniques.)  A  general  formulation  for  this  method  is: 

The  forecast  y^+m  ■  b^  +  bj_ 
where:  b^  -  2S'^  -  S”^ 

bj  -  (S\  -  s”t)/(i 

S\  -o^d^  +  (1  -ol) 

S\  +  (1  -<*)  S"t_i 

d^  >  demand  for  time  period  t 

ffl  *  number  of  periods  ahead  to  be  forecast 

^  ■  weighting  factor 


Forecasts  are  computed  for  three  alphas:  .10,  .15,  and  .20.  For  each 

forecast,  the  absolute  deviation  is  computed  as  the  absolute  value  of  the 
difference  between  the  last  month's  demand  and  the  forecast  of  the  last  month's 
demand.  The  single  exponential  smoothed  average  of  successive  absolute 
deviations  is  designated  as  the  mean  absolute  deviation  (MAD).  The  alpha 
forecast,  which  yields  the  lowest  MAD,  is  chosen  to  forecast  future  demand. 

Note  that  the  DLA  forecast  is  constant  over  all  future  periods. 

c.  Perishable  fresh  fruits  and  vegetables  (FF&V)  are  forecast  by 
the  individual  Defense  Supply  Offices  (DSOs).  Carlottable  hardy  FF&V  are 
forecast  using  the  demand  for  the  same  month  a  year  earlier  as  adjusted  by 
considering  intangibles  such  as  climatic  conditions,  fair  market  value,  and 
Increases  or  decreases  in  the  nimber  of  personnel  support.  These  forecasts  are 
largely  and  necessarily  subjective  since  such  intangibles  make  a  mechanical 
forecast  impracticable.  All  other  FF&V  are  purchased  daily  by  field  buyers  to 
satisfy  customer  requirements  received  by  telephone. 

d.  Item  managers  may  override  the  mechanical  forecasts  for  both 
perishable  and  semlperlshable  subsistence. 

Table  2  summarizes  the  current  demand  forecast  techniques  for  subsistence  items 
and  safety  level  computations. 
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FILL  quantity  refers  to  the  Fleet  Issue  Load  List  stocked  for  Navy 


3 .  Unique  Characteristics  of  Subsistence  that  Affect  the  Forecast 


Subsistence  item  demands  are  independent  in  the  sense  that  the  demands  are 
not  driven  by  demand  for  "higher  level"  end  items  as  are  the  demands  for  many 
hardware  items.  Subsistence  demands  tend  to  be  continuous  rather  than 

lumpy.  Subsistence  item  lead  times  and  procurement  cycles  are  short,  averaging 
4.5  and  1.3  months,  respectively.  The  Independence  and  continuity  of 
subsistence  demands  and  relatively  short  replenishment  cycles  improve  the 
chances  that  quantitative  forecasting  methods  can  be  applied  to  the  commodity 
with  success. 

Finally,  In  subsistence  inventory  management,  back  orders  are  not  filled. 
Therefore  future  demand  is  not  dependent  on  past  supply  performance. 

4.  Use  of  the  Demand  Forecast 

The  demand  forecast  is  used  in  subsistence  Inventory  control  'systems  to 
calculate  procurement  cycle  demand,  lead  time  demand,  and  safety  levels.  The 
sum  of  the  lead  time  demand  forecast  and  the  safety  level  combine  to  make  the 
reorder  point  which  determines  when  to  initiate  a  replenishment  buy  action. 
Presently,  the  procurement  cycle  and  lead  time  demand  are  computed  as  the 
monthly  demand  forecast  times  the  number  of  months  in  the  procurement  cycle 
period  and  lead  time,  respectively.  The  safety  level  computation  is  more 
complex  (see  Appendix  I).  Item  managers  frequently  override  the  present 
machine-generated  forecasts  with  their  own  calculations  for  seasonal  and  brand 
name  items. 

Safety  stocks  are  needed  to  cover  demand  during  the  lead  time  when  the  actual 
demand  exceeds  the  forecasted  demand,  the  actual  lead  time  exceeds  the 
forecasted  lead  time  or  both.  In  subsistence  inventory  control,  lead  times  are 
considered  relatively  constant  and  the  emphasis  is  on  the  variation  of  demand 
over  the  replenishment  cycle.  If  the  actual  demand  exceeds  the  forecasted 
demand  and  safety  level,  then  the  customer  will  receive  a  substitute  item  or 
nothing  at  all.  If  the  actual  demand  is  less  than  the  forecasted  demand  then 
Inventory  levels  rise.  Increasing  long  supply,  disposals  and  the  merchandising 
of  items  at  less  than  cost. 

C.  Description  of  the  Demand  Data  Base.  The  present  automated  supply 
system  for  perishable  subsistence  maintains  an  on-line  data  store  of  twelve 
months  of  demand  history  while  twenty-four  months  of  history  is  held  for 
semlperlshable  subsistence.  Offline  data  stores  of  monthly  demand  history  back 
to  July  1977  are  available  for  both  categories  of  subsistence  items.  For  this 
study,  each  item/  warehouse  demand  record  with  48  months  of  nonzero  demand 
beginning  November  1979  for  perishable  items  and  September  1979  for 
semlperlshable  items  was  extracted  and  analyzed.  The  existing  off-line  DPSC 
demand  data  base  which  contains  records  from  1977  to  1981  did  not  record  type 
pack  information.  Therefore,  the  demands  were  aggregated  by  type  pack  for 
each  stock  number  by  warehouse.  The  record  layout  is  provided  In  Appendix  C. 
A  description  of  the  record  fields  for  each  SN/warehouse  location  Is  provided 
in  Table  3. 


Table  3 


Field 

SN 

Type  Pack 
Depot  Code 

Issue  Code 
Supply  Code 

Item  Number 

Procurement 
Cycle  Period 

Lead  time 

Fleet  Code 
Chill  Code 
Shelf  Life 

Safety  Level 
Code 


Unit  of  Issue 

Average  Net 
Weight 

Nomenclature 


Recurring 
Demand  Qty 

Nonrecurring 
Demand  Qty 


IT EM/ WAREHOUSE  DEMAND  RECORD  FIELDS 
Description 

Stock  Number  (Brand  Name  -  7th  character  is  alphabetic) 

Domestic  Pack  •  1,  Export  Pack  *  2  (Semi perishable  only) 

Three  characters  •  semiperishable,  two  characters  >• 
perishables  (See  Tables  2  and  3) 

Troop  Issue  >1,  Commissary  Resale  >  2 

Item  Supplied  from  Warehouse  -  1,  Item  Supplied  from 
Direct  Vendor  Delivery  ■  2 

Five  digit  code  used  as  identification  in  lieu  of  SN 
Days  between  successive  procurements 

Days  between  initiation  of  a  buy  action  and  receipt  of  the 
product  at  the  depot 

Norfolk  or  Oakland  -  1,  Otherwise  ■  0  (Semi perishable  only) 
Chill  ■  1,  Freeze  ■  2,  Semiperishable  ■  9 

The  period  of  time  after  production  of  an  Item  during  which 
It  must  be  utilized 

If  VSL,  code  -  0 
Fixed  at  0  mos  >  1 

at  1-1/2  mos  ■  2 
at  1  mos  -  3 
at  1/2  mo  ••  4 

Designates  the  manner  by  which  an  Item  is  Issued  such  as 
Jars,  cans,  bags,  lbs. 

Weight  of  product  excluding  packaging 

Short  description  of  Item 

Perishable  Only 

From  the  customer's  perspective,  those  demands  that  are 
regular  in  frequency 

From  the  customer's  perspective,  those  demands  that  are 
irregular  in  frequency 
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Table  3  (Continued) 


Semiperishable  Only 

Troop  Issue  Demand  supplied  for  troop  feeding 

Demand 

Commissary  Demands  supplied  for  resale  in  Military  commissaries.  The 

Resale  Demand  items  demanded  may  be  troop  issue  items  as  well  as  brand 

name 


For  this  study,  the  demand  were  captured  monthly  from  July  1977  through 
November  1983. 


III.  DEMAND  FORECASTING  METHODOLOGY  AND  ANALYSIS 


A.  An  Overview.  This  section  of  the  report  describes  the  general 
philosophy  and  the  methodology  used  to  apply  quantitative  demand  forecasting 
techniques  to  the  Subsistence  Commodity.  Details  are  left  to  the  appendices 
In  Volume  I  and  Volume  II.  Figure  1  provides  an  overview  of  the  Demand 
Forecasting  Methodology.  There  are  six  components  to  the  methodology,  as 
follows : 


1.  Forecasting  System  Design  Considerations  -  This  area  describes 
the  general  environment  and  technical  problems  which  must  be  surmounted  In  the 
design  of  the  subsistence  demand  forecasting  system. 

2.  Data  Acquisition  and  Structuring  -  Data  acquisition  involves  the 
determination  of  the  number  of  demand  observations  and  Item  characteristics 
needed  to  analyze  subsistence  demand  patterns.  In  this  study  over  70 
observations  were  available  for  most  Items /warehouse  demand  series  so  that  It 
was  feasible  to  Identify  and  evaluate  the  underlying  demand  patterns.  Data 
structuring  Involves  the  aggregation  of  monthly  demands  into  lead  time  and 
procurement  cycle  sums  and  the  notation  used  to  predict  future  demands  based  on 
past  demands  over  a  predictor  period.  This  predictor  period  may  be  the  last 
iBonth,  last  lead  time  or  procurement  cycle  or  any  other  specified  period. 

3.  Forecasting  Techniques  -  This  area  provides  details  on  the  Identi¬ 
fication  and  fitting  of  a  wide  range  of  quantitative  forecasting  methods  to 
subsistence  demand  series. 

4.  Evaluation  Criteria  -  This  area  describes  the  various  statistical 
evaluation  criteria  used  to  rank  the  competing  models. 

5.  Model  Assignment  Analysis  -  This  area  Involves  the  assignment  of 
the  best  Individual  model  and  construction  of  the  best  group  of  forecasting 
methods  for  the  subsistence  commodity. 

6.  Areas  for  Further  Study  -  This  area  involves  suggestions  for 
further  study  including  adjusting  forecasts  based  on  the  nature  of  the  forecast 
error  and  monitoring  forecast  performance. 

In  the  remainder  of  Section  III,  these  components  are  described  in  more  detail. 


FIGURE  1 


OVERVIEW  OF  DEMAND  FORECASTING 
METHODOLOGY  AND  ANALYSIS 
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B.  Forecasting  System  Design  Considerations 

1.  Requirements  and  Technical  Difficulties.  In  designing  a  fore¬ 
casting  system  for  Subsistence,  the  following  requirements  and  technical 
problems  need  be  considered: 

a.  Need  for  Extended  Forecasts.  Common  practice  in  inventory 
control  is  to  forecast  one  period  ahead,  a  month  or  quarter,  and  then  to 
develop  forecasts  by  multiplying  the  forecast  by  the  number  of  periods  in  each 
lead  time.  However,  this  approach  Ignores  any  seasonality  or  trends  in  demand 
over  the  lead  time.  A  better  approach  would  be  to  forecast  demand  lead  time 
and  procurement  cycle  directly. 

b.  Need  to  Handle  Large  Numbers  of  Forecasts.  Due  to  the 
special  characteristics  described  in  Section  II,  subsistence  is  managed  by 
location;  and  accordingly  forecasts  are  by  item  and  location.  Demand  patterns 
for  an  item  do  vary  by  location,  thereby  necessitating  separate  forecasts  for 
each  location.  There  are  approximately  40  locations  and  4,000  items  for  a 
possible  total  of  160,000  forecasts.  The  actual  number  will  be  less  since  not 
every  item  is  stocked  at  every  location.  However,  since  the  number  of  required 
forecasts  is  large,  techniques  which  cannot  be  automated  are 
impractical . 

c .  Need  to  Limit  Number  of  Forecasting  Techniques.  Due  to  the 
volume  of  forecasts,  it  is  not  practical  to  fit  Individual  techniques  to  each 
item  for  each  location.  The  preferred  approach  would  be  to  find  a  point  of 
diminishing  returns  where  an  Increase  in  the  number  of  techniques  would  not 
significantly  Improve  forecast  accuracy.  Therefore,  the  number  of  techniques 
needs  to  be  limited  to  the  n\imber  that  will  not  overload  the  automated  system 
but  still  achieve  significant  Improvements  in  forecast  accuracy. 

d.  Bias  in  Selecting  Techniques.  Time  series  data  is  generally 
modeled  by  using  the  data  both  to  identify  the  model  (i.e.,  to  determine  its 
form)  and  to  estimate  its  parameters.  A  series  of  models  is  selected  (often  by 
a  stepwise  procedure)  and  the  parameters  of  these  models  are  estimated  in  the 
data.  The  model  that  best  fits  the  data  (i.e.,  with  the  smallest  error)  is 
selected.  Such  a  procedure  produces  a  favorable  bias  in  the  error  estimate 
that  Increases  with  the  number  of  models  considered.  "Cross-validation" 
methods,  where  a  portion  of  the  series  is  witheld  for  evaluating  the  error, 
would  produce  no  such  bias.  Such  methods  however  are  rarely  used  when  the 
tine  series  are  not  long,  both  because  recent  data  is  too  important  not  to  be 
used  in  model  development  and . because  of  the  extraordinary  amount  of  computa¬ 
tion  that  is  require  to  systematically  refit  and  test  portions  of  the  time 
series.  Instead  "Bayesian  methods"  that  utilize  a  distribution  of  prior  prob¬ 
abilities  over  the  set  of  candidate  models  are  sometimes  used  to  obtain  error 
estimates.  More  often,  a  model  developed,  by  the  analysis  of  a  relatively  short 
time  series  is  evaluated  by  using  all  points  of  a  time  series,  first  to  esti¬ 
mate  its  parameters  and  second,  to  evaluate  its  forecasting  errors  (Reference 
5). 


e.  Spurious  Fits.  The  problems  of  bias  described  above  are 
often  manageable  by  the  aforementioned  techniques  when  a  single  time  series  is 
being  fit.  Here,  however,  a  fundamental  problem  exists;  models  must  be 
developed  for  many  thousands  of  time  series  whose  relation  to  one  another  Is 
unknown.  A  model  selected  for  a  single  time  series  may  spuriously  fit  that 
series  well.  A  number  of  the  models  so  selected  for  many  time  series  will 
almost  certainly  be  spurious.  Cross-validation  of  each  Individual  model  helps 
little — many  models  will  most  likely  spuriously  survive  cross-validation.  Even 
were  such  problems  manageable,  the  use  of  conventional  methods  to  develop 
models  for  so  many  series  would  be  prohibitively  cumbersome,  time-consuming, 
and  expensive. 

f.  Piggy-Backing  Error.  Another  difficulty  in  using 

conventional  methods  to  develop  models  that  forecast  the  demands  for 
subsistence  Items  Is  that  their  computer  realizations  are  designed  for  use  in 
developing  models  that  forecast  the  next  point  In  a  time  series  (l.e.,  next 
month's  demand).  When  demand  over  a  longer  period  Is  required,  a  technique 
called  “plggy-backlng"  Is  used.  Here  the  forecast  point  Is  treated  as  the  last 
known  data  point  and  the  next  point  Is  forecast.  This  Is  repeated  until  the 
required  future  time  span  has  been  forecast.  This  procedure  unfortunately 
produces  an  error  that  rapidly  Increases  with  each  repetition.  Forecasts 
produced  In  this  manner  are  generally  useful  only  In  forecasting  the  near 
future.  In  subsistence,  the  sta  of  the  demands  over  a  procurement  cycle 
following  a  lead  time  (as  well  as  the  demand  over  the  lead  time)  must  be 
forecast  for  each  Item.  Forecasts  from  two  months  to  almost  a  year  Into  the 
future  are  often  required. 

2.  Approach  Taken  to  Resolve  Problems 

a.  Collection  Versus  Single  Series  Testing.  A  large  number  of 
models  were  tested  against  each  demand  series,  those  that  fit  these  data  best 
were  Identified  (but  not  selected).  However,  recognizing  that  the  performance 
of  these  models  may  be  spurious,  we  selected  models  according  to  their 
performance  on  a  collection  of  demand  series  rather  than  a  single  series.  Each 
such  collection  will  be  defined  In  terms  of  characteristics  of  the  Items  and 
their  demand  series.  A  single  model  will  be  used  to  forecast  all  demand  series 
In  each  collection.  The  definitions  of  the  collections  will  be  developed  by  an 
analysis  that  assumes  that  a  sufficient  nissber  of  series  are  In  each  collection 
so  as  to  maximize  the  precision  of  their  corresponding  models. 


b.  Division  of  Series  for  Development  and  Validation.  Prior  to 
the  formation  of  the  collections,  those  models  that  best  fit  each  demand  series 
were  determined.  A  validation  technique  was  used  to  estimate  the  forecasting 
error  produced  by  each  model.  This  estimate  Is  not  favorably  biased.  First, 
the  Initial  24  to  30  months  of  the  time  series  (depending  upon  Its  length)  were 
used  to  determine  the  parameters  of  the  model.  The  following  requisite  demand 
(over  lead  time  or  procurement  cycle)  was  then  forecast  and  compared  with  the 
actual  demand.  Thereafter,  for  each  point  of  the  demand  series,  the  parameters 
were  evaluated  using  only  the  demands  to  that  point,  and  a  forecast  was  made 
and  compared  to  the  actual  demand.  This  technique,  produces  a  slightly 
unfavorably  biased  estimate  of  forecast  error  because  only  a  portion  of  the 
series  Is  used  at  each  error  evaluation. 
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c.  Reorientation  of  Independent  Variables .  Rather  than  applying 
a  "piggy-backing"  technique  for  generating  forecasts,  the  models  used  directly 
forecast  either  the  sum  of  the  demand  over  the  lead  time  or  the  sum  of  the 
demand  over  the  procurement  cycle  following  the  lead  time  (different  models 
were  used  for  each).  That  is,  the  dependent  variables  were  such  sums  of 
demands  and  the  independent  variables  were  the  monthly  demands  or  a  sum  of 
demands  over  a  specified  predictor  period.  The  least  squares  fits  were 
performed  using  proprietary  software  in  conjunction  with  a  technique  for 
algebraically  operating  on  the  demand  series  to  automatically  construct  the 
requisite  matrices.  The  software  has  proved  sufficiently  economical  in 
computer  usage  so  that  it  has  been,  thus  far,  possible  to  set  the  parameters  of 
over  100  models  approximately  36  times  (l.e.,  1  for  each  of  36  time  periods) 
for  both  the  lead  time  and  procurement  cycle  forecasts  for  each  of  3,925  item/ 
warehouse  demand  series.  This  number  of  tests  was  used  to  estimate  the  errors 
produced  by  each  model  on  each  demand  series. 

C.  Data  Acquisition  and  Structuring.  The  central  theme  of  quantitative 
forecasting  is  the  assumption  that  some  pattern  exists  in  what  has  gone  before 
and  that  the  pattern  will  continue.  Each  forecasting  technique  makes  explicit 
assumptions  about  the  type  of  underlying-  pattern.  The  ability  of  a  given 
technique  to  forecast  effectively  in  a  specific  situation  depends  largely  on 
the  characteristics  of  the  pattern.  There  are  five  types  of  basic  patterns 
usually  identified  as  follows: 

1.  Level  is  defined  as  the  average  of  the  demand  values  over  a 
specific  period  of  time. 

2.  Trend  is  defined  as  the  growth  or  decline  occurring  in  demand 
values  over  time. 

3.  Seasonality  Is  defined  as  regular  movcaaents  of  demand  at  fixed 
time  Intervals  apart.  The  length  of  the  fixed  time  Interval  Is  known 
as  the  period  of  the  movement.  Periods  of  12  months  may  exist  for 
Ice  cream,  spare  ribs,  strawberries,  etc. 

4.  Cycles  are  usually  due  to  long  term  business  activity  and  are  not 
addressed  In  this  study  since  the  predictive  periods  for  the 
subsistence  Items  are  relatively  short. 

5.  Randomness  represents  sporadic,  short-lived  movements  In  demand 
due  to  chance  events.  Randomness  Is  reflected  In  the  residual  left 
after  a  demand  series  has  been  removed  of  level,  trend,  and 
seasonality. 

The  purpose  of  these  statistical  forecasting  methods  Is  to  Identify  and  track 
the  level,  trend,  seasonal,  and  random  components  of  the  demand  patterns.  In 
the  analyses  in  this  report,  each  class  of  forecasting  techniques  is  evaluated 
as  to  their  appropriateness  to  identify  and  track  these  components. 

Data  requirements  for  statistical  forecasting  vary  depending  on  the  technique 
chosen.  In  this  study,  at  least  24  lead  time  demand  observations  were  used  to 
fit  the  respective  technique.  The  technique  was  then  evaluated  for  accuracy 
over  the  next  24  to  40  months  against  the  current  subsistence  forecast  method. 
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Table  4  depicts  the  notation  and  data  structuring  used  to  generate  and  evaluate 
demand  forecasting  techniques  for  the  subsistence  commodity. 

Table  4 

DATA  STRUCTURING  FOR  SUBSISTENCE  DEMAND  FORECASTING 


Monthly 

Demands 


Jan 

80 

X31  X32  X33  ...  X52  X53  ...  Xg3  Xg2  Xg3 


X71  X72  X73  X74  X75  X7g 


Nov 

83 


^77 


Let:  t  >  the  last  month  of  observed  demand 

LT  «  the  lead  time  (In  months)  for  an  Item 

PC  ■  the  procurement  cycle  (In  months)  for  an  Item 

X^  *  the  observed  demand  In  month  t 

0^  ^  *  total  demand  over  R  months  Including  and  Immediately  preceding 

R 

month  t:  -  E  X^+i.r 


<■  *  the  sta  of  the  demands  over  the  lead  tlise  following 

LT 

month  t:  Dt+LT,LT  “  ^  *t+l 


■  ^t-fLI^PC  PC  **  demands  over  the  procurement 

cycle  after  the  lead  time  following 

month  t;  *^t+LT+PC,PC  “  ^  ^t+LT+i 

1-1 


«  the  number  of  '‘lags'*  used  in  autoregressive  models — the  number  of 
demands  Including  and  immediately  preceding  the  current  demand 
that  Is  used  In  the  autoregressive  models 

A 

Y|.  -  forecast  for  lead  time  demand 

A 

■  forecast  for  procurement  cycle  demand. 
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2.  Example  of  Notation  Used  for  Forecasting  Techniques 

An  example  of  this  notation  for  autoregressive  techniques  follows. 

Let  item  S  be  a  semiperishable  item  with  a  lead  time  of  k  months  and 
procurement  cycle  of  2  months.  For  semiperishable  items,  30  months  of  data 
were  used  to  initially  fit  different  forecast  models. 

The  notation  in  Table  4  is  applied  as  follows: 

Monthly 

Demands 

*25  *26  ^27  •  •  .  *30  X31  X32  X32  X33  X34  X35  X3g  X37  .  .  . 


At  t  ■  30,  the  next  lead  time  demand  for  item  S  is  030^  ^  «  1)3^  ^  »  X3j^ 
+  X32  +  X33  +  X3^.  At  t  •  30,  the  next  procurement  cycle*  demand  ’for  item 
S  is  ^30+4+2  2  *  °36  2  *  *35  '*■  *36*  example,  a  forecast  will 

be  generated  for  a  sinqiie  autoregressive  model  (without  constant)  lagged  one 
monthly  period.  The  autoregressive  models  contain  coefficients  displaying  the 
portion  of  past  performance  which  affects  or  explains  future  performance.  The 
first  30  months  are  used  to  Initially  fit  or  ''prime”  the  forecasting  models. 

The  simple  autoregressive  forecast  for  the  next  lead  time  demand  is  a^X^q 

where  a.  is  determined  by  the  initial  fitting.  For  example,  if  a^  ■  2.62, 
FORECASTCXjj  +  X32  +  X33  +  X34)  -  2.62  *  X^q.  Similarly,  forecast 
for  the  next  procurement  cycle  demand  Is  b3X3Q  mere  b.  is  determined  by 

the  initial  fitting.  If  b^  -  1.64,  then  FORECAST(X35  +  X3g)  -  1.64  * 
XoQ.  At  month  34,  the  le^  time  FOEECAST,  ACTUAL  ERROR  -  ACTUAL  - 

FORECAST  values  are  recorded.  At  month  36,  the  Procurement  Cycle  Forecast, 
Actual  and  Error  >  Actual  -  Forecast  Values  are  recorded.  At  month  31,  the 
procedure  is  repeated  to  develop  a  FORECAST(X32  +  X33  +  X3^  +  X33)  and 

a  F0RECAST(X3g  ^37)*  autoregressive  coefficient  is  updated  also. 

The  procedure  Iterates  until  we  forecast  D73  ^  for  lead  time  demand  and 
D77  2  procurement  cycle  demand.  The  va*lues  recorded  are  altogether 

recorded  for  further  analysis. 

D.  Forecasting  Techniques 

I.  Discussion.  In  this  section,  a  short  description  of  the 
classes  of  forecasting  techniques  employed  in  this  study  is  provided.  More 
detail  is  available  in  Appendix  N.  The  forecast  techniques  were  selected  for  a 
variety  of  reasons  depending  on  the  nature  of  the  underlying  demand  patterns. 
In  particular)  Autoregressive  Integrated  Moving  Average  (ARIMA)  models  were 
avoided  because  a  monthly  update  of  the  parameter  estimates  is  computationally 
expensive  and  difficult. 


2.  Description  of  Techniques.  A  short  description  of  each  class  of 
forecasting  technique  is  given  below.  Details  are  left  to  Appendix  N. 

a.  Autoregressive  Models  An  autoregressive  (AR)  model  assumes 
that  near  item  future  demands  are  dependent  on  past  and  current  demands.  The 
coefficients  in  the  autoregressive  model  display  the  fraction  of  the  knovm 
demand  affecting  the  future  demand.  In  this  study,  the  autoregressions  were 
limited  to  lags  of  1,  2,  or  3  periods  past.  The  study  also  considered 
logarithmic  and  square  root  auto  regressive  models  (LAR,  SAR,  ARl ,  AR2  and  AR3) . 

The  AR3  forecasts  would  be  as  follows: 

Lead  Time  Demand  Forecast  «  a^  *  (last  period's  demand) 

+  a2  *  (demand  two  periods  ago) 

+  a^  *  (demand  three  periods  ago) 

+ 

where  the  parameters,  a^ ,  are  determined  by  least  square  fits. 

Procurement  Cycle  Demand  ■  b^  *  (last  period's  demand) 

Forecast  +  b2  *  (demand  two  periods  ago) 

■f  b^  *  (demand  three  periods  ago) 

+  b4 

where  the  parameters,  b^,  are  determined  by  least  square  fits. 

We  may  set  a^  ■  b.  *  0  (autoregressive  without  constant)  or  we  may  achieve 
extra  freedom  in  tne  model  fitting  by  allowing  all  real  values  for  a^  and 

b4. 

The  inclusion  of  parameters  a.  and  b4  allows  for  tracking  the  average  level 
of  demand  over  the  sttidy  period  so  that  the  autoregressive  parameters  can  model 
changes  in  the  average  demand.  This  allows  for  demand  series  with  a  relatively 
constant  change  in  demand  to  be  fit  by  netting  the  autoregressive  parameters 
equal  to  the  periodic  changes.  In  fact,  a  fractional  change  in  demand  may  be 
modeled  by  the  autoregressive  parameters  while  the  constant  terms  capture  the 
additive  component  of  change  in  demand.  Some  of  the  benefits  of  Integrated 
models  (to  be  discussed)  may  be  achieved  by  these  models  while  integrated 
techniques  can  be  used  to  fit  varying  changes  in  demand. 

b.  Autoregressive  Models  with  Harmonic  Terms  These  models  (ARl 
HARM,  etc.)  are  identical  to  the  autoregressive  models  above,  except  for  the 
Inclusion  of  a  harmonic  term.  A- sin  [  (2t  t  +6)],  which  introduces  a  amplitude 

C 

change  and  phase  shift  at  time  t  to  the  fitting  of  the  demand  data.  In  this 
study  only  C  *  12  for  monthly  demands  was  examined. 


Note  that  for  computational  purposes: 


These  models  will  capture  consistent  sinusoidal  seasonal  variations  in  demand. 
However,  if  the  seasonal  effects  ‘are  changing  from  year  to  year  and  the 
variations  are  not  sinusoidal,  these  models  may  introduce  serious  distortions. 


c.  Autoregressive  Models  with  Lag  Seasonal  Terms.  These  models 
(ARl  LAG,  etc)  are  identical  to  the  autoregressive  models  with  the  exception 
that  an  additional  demand  period  12  months  prior  was  included  for  extra  freedom 
in  the  autoregressive  fitting  process.  These  models  have  the  additional 
feature  over  simple  autoregressive  models  of  tracking  varying  seasonal  effects 
that  are  not  sinusoidal.  The  predictor  periods  and  the  lag  periods  (3,  6,  9, 
etc.)  may  be  altered  based  on  management  concerns.  For  example,  if  cheese 
items  exhibit  quarterly  peaks  due  to  customer  buying  habits  at  certain  times, 
these  methods  can  best  track  the  seasonal  component  and  result  in  better 
forecasts. 

d.  Integrated  Autoregressive  Models.  While  autoregressive  models 
with  a  constant  can  model  certain  additive  trends ,  integrated  autoregressive 
models  (lAR)  can  best  predict  demand  when  the  trend  component  changes 
stochastically  subject  to  random  shocks.  These  Integrated  autoregressive 
models  are  similar  to  autoregressive  models  except  that  the  Independent 
variable  is  the  difference  in  demand  between  successive  time  periods  and  the 
dependent  variable  is  the  difference  between  the  forecast  and  this  period's 
demand.  A  constant  may  be  included  in  the  regression,  if  necessary. 

e.  Integrated  Autoregressive  Models  with  Harmonic  Terms .  These 
models  (lAR  HABM)  are  similar  to  the  above  except  for  the  addition  of  the 
harmonic  term.  They  may  be  used  when  the  demand  pattern  exhibits  varying  trend 
and  relatively  constant  sinusoidal  seasonality. 

f*  Integrated  Autoregressive  Models  with  Lag  Seasonal  Terms. 


These  model  (lAR  LAG)  are  identical  to  Integrated  autoregressive  models  with 
the  exception  of  an  additional  term  which  is  the  difference  of  demand  over 
successive  periods  12  months  ago.  (See  Appendix  M  for  the  formula.)  They 
nay  be  used  to  model  varying  trend  and  "spiked"  seasonal  demand  patterns. 

Longer  predictor  periods  can  smooth  out  random  fluctuations  in  the  demand 
data.  For  this  study,  lead  time/procurement  cycle  demand  and  six  month  sums  of 
demands  were  examined. 

Integrated  (short-term  differenced)  data  are  used  to  stabilize  time  varying 
levels  while  logarithmic  and  square  root  transformations  are  included  to 
stabilize  time  changing  standard  deviation  and  variance  of  the  demand  data 
respectively.  Harmonic  and  lag  seasonal  models  are  Included  across  all  these 
classes  of  models. 

g .  Averaging  Methods 


Averaging  methods  (MO  AVG)  employed  in  this  study  were  limited  to  3,  6,  9,  12, 
15,  18,  21,  24,  and  36  months  moving  average  and  a  arithmetic  average  or  global 


The  moving  average  methods  generate  the  next  period's  forecast  by  averaging  the 
actual  demand  over  a  certain  period.  These  methods  are  intended  to  cancel  out 
random  fluctuations  in  demand.  The  methods  do  not  accommodate  seasonality.  A 
wide  range  of  periods  was  studied  to  determine  the  proper  length  of  period. 


Too  few  periods  will  result  In  seriously  distorted  forecasts  Influenced  by 
random  variations  In  demand.  Too  many  periods  will  result  In  lagging  forecasts 
which  fall  to  track  trends.  When  the  level  of  the  demand  does  change,  the 
proper  moving  average  will  respond  well  unlike  the  last  period  demand  forecast 
which  will  fall  to  adjust  at  all. 

The  arithmetic  average  or  global  mean  Is  the  arithmetic  average  of  all  actual 
demand  values  from  the  start  to  the  end  of  the  evaluation  period. 

The  arithmetic  average  will  smooth  out  random  fluctuations,  but  for  long 
evaluation  periods.  It  does  not  respond  well  to  trends  nor  seasonality.  It 
takes  little  account  of  recent  data.  It  Is  appropriate  for  randomly 
distributed  data  with  a  constant  level. 

h.  Naive  Methods.  Managers  often  look  to  the  last  period's  data 
or  this  period's  data  one  year  ago  before  making  decisions  concerning  stock 
buys  and  levels.  In  this  report,  these  techniques  are  denoted  as: 

(1)  Last  Period's  Observation.  For  this  method,  actual 
demand  Is  the  forecast  for  the  predictor  period.  The  last  period's  observation 
may  work  well  with  data  that  exhibit  local  monotonlc  trends,  but  It  does  not 
accommodate  seasonality  and  oiay  "chase"  random  fluctuation  resulting  In  poor 
forecasts. 

(2)  This  Period  Last  Year.  This  technique  (LAST  YEAR)  merely 
uses  the  demand  recorded  for  the  predictor  period  one  year  ago  as  the 
predictive  period  forecast.  This  method  Ignores  recent  observations  and 
therefore  falls  to  track  trends.  The  method  Is  appropriate  for  demands  with  an 
annual  seasonal  pattern  and  constant  level;  however,  it  can  overreact  to  random 
fluctuations. 

1.  Exponential  Smoothing  (Exponentially  Weighted  Moving 

Average) .  Exponential  smoothing  techniques  are  widely  used  in  Government  and 
industry  due  to  their  ease  of  computation  and  minimal  data  retention 
requirements.  Single  exponential  smoothing  (SES)  and  double  exponential 
smoothing  (DES)  are  more  commonly  used. 

The  choice  of  a  smoothing  constant  is  critical  to  the  performance  of  the 
exponential  smoothing  methods.  The  order  of  exponential  smoothing  is  usually 
decided  by  visual  inspection  of  the  data.  For  desMnd  series  with  slowly 


changing  levels,  single  exponential  smoothing  is  selected.  For  demands  that 
grow  or  decay  linearly  over  time,  double  exponential  smoothing  is  chosen. 
Smoothing  constants  between  .05  and  .30  are  usually  suggested.  However,  In 
this  study,  smoothing  constants  of  .4,  .5,  .6,  .7,  .8,  and  .9  were  also  tested. 


There  are  many  methods  to  adjust  exponential  smoothing  for  seasonal  patterns. 
One  such  famous  method  is  known  as  Winter's  seasonal  forecast  procedure. 
Winter's  procedure  incorporates  three  smoothing  constants;  one  to  update  the 
level,  one  for  trend,  and  one  for  seasonality.  Because  of  the  effort  required 
to  estimate  the  proper  smoothing  parameters,  the  Winter's  method  was  not 
included  in  this  study. 
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Extreme  care  must  be  taken  when  describing  the  formulae  and  computer  code  for 
double  exponential  smoothing.*  Many  erroneous  formulae  have,  in  fact,  been 
published  and  caution  is  warranted  when  dealing  with  the  subject.  The  correct 
formula  for  the  one  period  ahead  forecast  under  double  exponential  smoothing  is: 

(2S^  -  S^)  +  (S^  -  S^) 

where  is  the  single  smoothed  average,  is  the  double  smoothed  average 
and  o(.  is  the  smoothing  constant. 


i  • 

c 

$ 


i 


*  See  Reference  3;  Gardner,  E.  S.,  "The  Strange  Case  of  the  Lagging  Forecast,' 
Interfaces ,  May-June  1984. 
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As  used  by  DLA,  Che  subsistence  semlperlshable  forecast  calculates  the  double 
smooched  one  period  ahead  forecast  correctly,  but  then  simply  multiplies  Che 
monthly  forecast  by  the  lead  time  period.  Trends  are  assumed  constant  over  Che 
lead  time. 

The  exponential  smoothing  parameters,  OC ,  In  the  single  and  double  exponential 
smoothing  formulae  above,  are  constant. 

Another  technique  known  as  Adaptive  Response  Rate  Single  Exponential  Smoothing 
(ARRS(Y))  allows  for  Che  controlled  change  of  Che  smooching  parameter.  At  each 
period,  Che  absolute  value  of  Che  single  smooched  average  error  and  Che  single 
smooched  average  absolute  error  through  Che  last  period  Is  calculated.  The  new 
smooching  constant  Is  chosen  as  the  minimum  of  this  ratio  and  V  .  The 

constraint  method  was  needed  due  to  wild  forecast  fluctuations  when  the 

smooching  was  unconstrained.  COMBINED  exponential  smoothing  Is  discussed  In 
Section  IlIE. 


3.  Model  Identification.  Figure  2  provides  a  schematic  of  the  data 
structuring  and  forecast  model  development  used  In  this  study.  The  first  task 
of  Model  Identification  Involved  fitting  the  various  autoregressive  forecasting 
schemes  to  the  demand  data.  First,  using  a  set  number  of  points  to  prime  the 

models;  second,  to  generate  a  single  predictive  period  forecast;  and  third,  to 

recursively  add  points,  refit  the  regression  and  generate  lead  time  and 
procurement  cycle  forecasts  until  actual  demand  periods  are  exhausted.  The 
Model  Identification  phase  Involved  processing  approximately  7,850  series  of 
subsistence  demand  history  through  over  100  autoregressive  type  models  as 
described  In  Section  III  and  Appendix  M.  A  typical  Iterative  autoregression 
report  Is  provided  In  Table  5. 

Table  5  depicts  the  fitting  of  an  integrated  autoregressive  harmonic  model  to 
the  demand  series  for  Pork  Spareribs  stocked  at  Bremerhaven,  Germany.  The 
predictor  period  Is  six  months,  i.e.,  six  month  sums  of  demand  are  used  to 
estimate  the  lead  time  and  procurement  cycle  demand. 

The  key  statistics  In  Table  5  are  given  in  the  RESULTS  area  at  the  bottom  of 

the  report.  It  Is  Important  to  note  that  the  Mean  Absolute  Deviation  (MAD)  and 

the  Mean  Absolute  Percentage  Error  (MAPS)  are  generally  considerably  less  for 
the  subject  model  (IFCT)  than  the  present  DLA  model  (DFCT).  The  MAD  and  MAPE 
are  measures  of  forecast  accuracy.  Appendix  B  provides  a  detailed  description 
of  the  terms  In  the  autoregression  report. 

The  fact  that  the  subject  model,  which  Is  seasonal,  has  been  more  accurate  In 
forecasting  this  Item's  demand  would  Indicate  that  the  demand  pattern  may  be 
seasonal.  It  must  be  considered  that  six  parameters  were  required  to  generate 
this  model.  A  simpler  model  may  Identify  the  seasonal  pattern  and  perform  Just 
as  well. 

After  developing  the  report  In  Table  5,  the  nomenclature  and  other  Item 
data ,  the  actual  lead  time  and  procurement  cycle  demand ,  and  the  forecast 
errors  from  the  autoregressive  models  are  stored  for  further  analysis. 

In  stimmary,  Table  5  provides  a  report  for  comparing  various  autoregressive 
forecasting  models  against  the  present  DLA  method.  Various  statistical 
measures  of  forecast  accuracy  such  as  mean  absolute  deviation,  mean  error,  and 
mean  absolute  percentage  error  are  given  to  assist  the  analyst  in  reviewing 
various  autoregressive  models. 
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fr.*' 


FIGURE  2 


SCHEMATIC  OF  DATA  STRUCTURING 
AND  FORECAST  MODEL  DEVELOPMENT 
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Table  5 


SAMPLE  AUTOREGRESSION  REPORT 


a0V®‘^^M^0C'*^C^*Mf^W®00'^C^^CNCN0*“CNin0®CN0CN^000vCN0 


w®io®r^^(*5a»®r**incivinr^«®®^®MuiO«‘^v®0't***^Mr)a>n®*-oc‘'0 

ao>^OOc'<tfi««r«‘rjo^<or*“ioo>Q®r^fflMc^tnrj®®BMr^^*-^00>r^io®cw 

0®Or»®r*»r^r*>^r*‘®inr*>ciifl^®00®r*^s®M®in®Oso<t^®®®U)r>«-vc^® 


uiae®®®o®<Nr«^®min^r*‘in(*)oi®(*»' 

<  . . 


uia^nMci®f**Orttf>®*"tOf*^o«<7'‘^tf>OOif>^t^*“0'®»r*»o®o>«»nr)v®ir) 
^uiMS^®a^O)®^O®ncna0i®®'^®Qo®®f>»tf>vO  M^vvrv^Bc^Or^® 
u  Mtnr^^cnrH®«-r^®<*)Oc<h-(n®®®®Of^®Y(0®®*’  9>^  r>®®‘0  0>M® 

>  ••ll  •!•-  I  (1^ 

I  I  I  It  I  I  t  I  I  « 

ZH®®(s®®®^r<‘CN®ioc^«n®n®iOio®in®iAesv®®®Qi0Oo<®'’*ir>c^®r>‘ 

ujo*-®00nf*^f^r^«0rt0^0®^®00no»r>r^nva>r*“^0^®»n®t^vo>n*“ 

Sa®0)«^tnh>^®^®nc^iAO)ai^t^4nn®^00>(NMiDiAtAot*^o<tf>«>cMNQn® 

ui*«(*)Ot®no®<N^^®^Oa®®f*»in^^<*)«tf)MOr^O*~tACMO®ioa>tnfM®o® 

X 

<j 

o 

ah-n<Nr>^«-aO®^n®®r*'<^r*»4n®0®f^r*ocx^>nnOmOion®0®®mo®c4c>< 

I 

tt9^»«a«*®in®n^Oci«*®OOuir^r^r*‘®inu>f>a®'^O^^ionr^^o>«*nr^ 

aO^MCin^OO'^MCIOICI^tfJOIPJO^'Cf^CNWOOMW^^W^PI^OOOOW 


a^OP®riMWnO0>®®tf5i0r*ci«r^OO®®O^0>iPOi0^r>**r^r«-^CNOir0» 
a^®0)r*®*r‘®^r*^®r«r**^cin^®®p5®©®in»*r^®cNr^MNO^r*»^o»^ 
uj®®r)0®*r*oi0nr)®^r*i®r»-®^^t«»00'"®^nr»»®0n®r*^n®v®0® 
®®®®r»*mr-cicN®  —  ®0tf>^0®®^'*c<®*“®®«'^®®n®-»nin^^c)® 

I  t  t  I  I  I  I  I  ^  I  I  I  t  I  I  I  I  I 

I 

Kr«^®Oci«®r»o^®^®O®®®n^®®onM^®®OYV®r^®0c«^®® 

(/)u®Y®<M®®®®®p^O®c<o®nMMtf)r*>c<®^c»nO®®t*>®®^®^iPC<r^ 

uia®n^0®®^®®0c<in0^r^®^®^®®r^®^®®®®r4inn®nvr)®®r*> 

H»o®0^p**"wn^n®®c'i«r»*®®0«®«^^r^®®®«^®**®®r^r^«nr^® 

SO^nOOr^^«^^®f*®cioi«®ci’^»-^^«®®0®r«*®^00  —  n^PJww 

M 

(^CKOr^®^®®^®®®m^^ncf®r)n®or>dptr>Yr«nnnn«*nr«r«®®Ym 

uia^OOnn^OO'^^OO^OMW^^^OO^OO'^OO^^'^OOOwwnnn 


^ar>^r“r“OW«Or*c»®^p»-®pnr^«QO^®^W0^^«0®f**'®^f**n0^f' 

uiui®®r*»«*0^®®r»«-®n«”^O®Of*^^c«r^®v®c^f^®n®n®n)O®O®v® 

^wcii  i«  ^  a  i 


►-p®p**®®'«rio®^0'^®p'r*^oi^^^p^®®n^Onh»in^Onp)Bio(N^nv 
UO«r***-r^«fMO^Oif)®«p^®r^f^®®citf)r-®®i^O»^nOO>^®Qf**0'^'C*J 
u.inoin^P«®cN  —  inin®oo»r*'^®^M  —  vwci0in®®®^ir)0i^Q0®0®® 
w^^Bnr-npio^oncstfjpOO'ioin®^  —  ®®cNioo^  —  ^fNpnOBO>^®^ 

—  Oaioavo^CMncNTr®®!*-®®^ 

C>|«-«*rMCN*-*^«-CNCNr4CN«>^  — 


►•®^®c<0®®^Onirtr«‘*-ifl®^r‘Ov®n®n^CN®«inOHp^inr>-0^**0 
on«Pv^«inOf*-«®®®^«r>®r«‘®r)’^B'^®h»^c*)c<no^^cscs^®n® 
<'<r®r«‘as'“®<NnoniopcN«r*»citfj®®r>f«»r«‘r«*vr^r)BnciMMninO®ir^o> 
®^ci'-^®*-cNinn®»-«**«p^-’Otf>®n«cN  —  ^OinOar^ootN**®^® 
ciO®®®viflin®«OcNno»^0-’n^®t*^POff>«®tf>fN'"OM^vnn(*)(NO 

X®f^®wO'^<Nn^io®r>*®0io*f^n^tf)®r^®®O*“f^f^^in®^*®<y'O^Mn 


-■ '^.v;>>.v 


ini'n 


"hN'v'- 


B 


NO  OF  FIT  PARAMETERS  -  6 

lEAD  T}Mt  PARAMETERS  .  -.72  -l.OJ  -.74  23264.16  41052.29  -9041.75 

PROC  CYCIE  PARAMETERS  .  .27  .05  -.58  -19487.57  9958.97  -2671.50 


The  next  part  of  Model  Identification  Involves  the  additional  selection  of 
exponential  smoothing,  moving  average,  and  naive  methods  to  the  autoregressive 
methods.  The  user  may  select  any  combination  of  these  desired.  In  this  study, 
a  wide  range  of  moving  averages ,  exponential  smoothing  models  for  different 
smoothing  parameters,  and  two  naive  models  were  investigated.  Model  evaluation 
then  begins. 

E.  Evaluation  Criteria 


One  goal  of  a  forecasting  system  is  the  minimization  of  the  total  forecast 
error  Incurred  over  time.  Traditionally,  squared  forecast  errors  have  been  a 
useful  measure  of  accuracy  with  Mean  Squared  Error  (MSE)  recognized  as  a 
popular  choice. 

MSE  is  defined  as  follows: 


MSE  •  E  (At  -  Fj.)^ 
n  t“l 

where:  is  the  actual  demand  and  is  the  forecasted  demand. 

MSE  is  closely  related  to  variance  and  is  widely  accepted  in  statistics  as  a 
measure  of  being  close.  Root  Mean  Squared  Error  (RMSE)  is  the  square  root  of 
MSE  and  is  closely  related  to  standard  deviation. 

The  squared  error  measures  have  the  advantage  of  penalizing  large  forecast 

errors  and  ignoring  the  sign  of  the  error.  One  drawback  of  squared  error 
measures  is  determining  the  level  of  significance  between  two  models.  For 

example,  what  is  the  significance  of  accuracy  between  an  RMSE  of  25  and  30? 
This  limitation  notwithstanding,  the  ratio  of  the  RMSE  of  a  test  model  versus 
the  RMSE  of  the  current  DLA  method  and  the  standard  deviation  of  this  ratio  are 

included  as  evaluation  criteria  for  model  selection.  Table  6  is  a  sample 

model  test  set  evaluation  report.  In  it,  the  models  are  ranked  by  RMSE  and 
the  ratio  of  the  RMSE  for  the  test  model  and  the  RMSE  for  the  no-change  model 
(LAST  LT/PC) .  A  complete  description  of  the  model  evaluation  report  is 
provided  in  Appendix  E. 

There  are  economic  benefits  to  be  gained  by  demand  variance  reduction.  In  DoD 
Inventory  models,  the  total  variable  cost  is  the  sum  of  ordering,  holding,  and 
stockout  costs.  A  Subsistence  Inventory  Simulation  is  not  presently  available 
to  test  the  performance  of  different  forecasting  models  in  terms  of  total 
Inventory  costs.  However,  it  has  been  documented  that  a  particular  forecasting 
model's  accuracy  (as  measured  by  Mean  Squared  Error)  plays  a  vital  role  in 
keeping  total  stockout  costs  reasonable  and  that  holding  costs  can  be  reduced 
by  study  of  the  sources  of  lead  time  demand  variance  (Reference  lA). 

Other  evaluation  criteria,  used  in  this  study,  relate  to  the  Theil  decomposition 
of  the  forecast  error  into  bias,  regression,  and  disturbance  proportions.  Bias 
distorts  forecast  accuracy  through  systematic  overforecasting  or 
underforecasting .  When  Thell's  bias  proportion  exceeds  .2,  the  model  Is 
rejected  for  selection.  For  a  complete  description  and  application  of  the 
Theil  decomposition,  the  reader  should  review  References  15  and  16, 
respectively. 
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SAMPLE  FORECAST  MODEL  EVALUATION  REPORT 
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During  the  evaluation  phase,  extensive  testing  was  performed  on  the  present  DLA 
use  of  exponential  smoothing  for  semi perishable  subsistence.  The  present 
formula  uses  smoothing  constants  of  .1,  *15,  and  .2  (.2  only  for  brand  name 

Items)  and  simply  extends  the  one  period  ahead  double  exponential  smoothed 
forecast  through  the  lead  time  and  procurement  cycle. 

The  decision  rule  to  switch  the  smoothing  constant  Is  made  on  the  forecast 
formula  which  has  the  least  smoothed  mean  absolute  deviation  through  the  last 
month.  The  current  DLA  formulation,  on  the  average,  outperformed  true  double 
exponential  smoothing  for  semlperlshable  subsistence;  however.  It  was 
consistently  less  effective  than  single  exponential  smoothing. 

These  findings  led  to  the  testing  of  various  decision  rules  for  selecting  the 
smoothing  constant  and  the  kind  of  exponential  smoothing  (single,  DLA 
formulation,  and  double).  A  combined  exponential  smoothing  model  was  designed 
originally  as  a  conglomerate  of  18  exponential  smoothing  models  (single,  DLA 
formulation,  and  double)  for  smoothing  constants  .05,  .1,  .15,  .2,  .25,  and  .30. 

The  following  decision  rules  on  switching  models  within  the  COMBINED  model  were 
tested: 

1.  Select  on  least  smoothed  MAD  over  the  last  lead  time  or 
procurement  cycle,  respectively,  with  a  smoothing  constant  of  .1. 

2.  Select  on  least  smoothed  MAD  over  the  last  lead  time  or 
procurement  cycle,  respectively,  with  the  smoothing  constant 
presently  In  use. 

3.  Select  on  least  smoothed  squared  error  over  the  last  lead  time  or 
procurement  cycle,  with  a  smoothing  constant  of  .1. 

4.  Select  on  least  smoothed  squared  error  of  the  last  lead  time  or 
procurement  cycle,  respectively,  with  the  smoothing  constant 
presently  In  use. 

Model  assignment  analyses  (described  In  next  section)  were  then  made  on  a 
sample  of  800  series.  Decision  rules  1  and  3  were  found  to  be  superior  to  2 
and  4  In  terms  of  reduced  BMSE  and  compactness  distribution.  Decision  rule  I 
was  slightly  better  than  rule  3  In  terms  of  reduced  BMSE  and  the  number  of 
series  with  a  positive  improvement. 

Analyses  were  then  performed  on  the  smoothing  constant  to  test  If  changing  the 
constant  for  smoothing  the  MAD  would  Improve  forecast  accuracy  for  decision 
rule  1.  Model  assignment  analyses  were  performed  for  smoothing  constants  of 
.05,  .1,  and  .2.  The  smoothing  constant  of  .2  performed  slightly  better  than 
the  others  In  terms  of  reduced  BMSE  and  number  of  series  with  a  positive 
Improvement . 

Smoothing  the  MAD  with  a  constant  uses  the  same  set  of  weights  for  the  errors 
of  any  of  the  models.  When  an  o(  of  .2  Is  employed,  74  percent  (l-(.8)°)  of 
the  weights  used  In  the  smoothed  MAD  Is  given  to  the  last  six  errors  while  93 
percent  (l-(.8)^^)  is  given  to  the  last  12  errors. 

The  combined  exponential  smoothing  method  throughout  this  report  will  be 
denoted  as  COMBINED. 


The  original  COMBINED  model  performed  better  than  any  other  Individual  model 
wh^n  assigned  to  semlperlshable  subsistence  demand  series.  However,  it  was 
rather  cumbersome.  Further  testing  indicated  that  the  range  of  exponential 
smoothing  formulations  and  smoothing  constants  could  be  narrowed  down  without 
appreciable  deterioration  in  forecast  accuracy  for  the  COMBINED  model.  When 
the  COMBINED  model  was  limited  to  the  single  and  DLA  formulations  for 
exponential  smoothing  with  smoothing  constants  of  .1,  .2,  and  .3,  a 

deterioration  of  only  .7  percent  In  average  RMSE  was  realized. 

This  results  in  a  reduction  of  data  storage  requirements  from  36  to  12  values 
per  item/ warehouse  record  for  this  model. 

The  model  evaluation  phase  provided  a  means  to  rank  the  various  forecast  models 
according  to  statistical  accuracy.  At  the  completion  of  the  model  evaluation 
phase  there  was  enough  Information  available  to  begin  to  study  the  problem  of 
assigning  forecast  models  to  classes  of  subsistence  Items. 

F.  Model  Assignment  Analysis 

1 .  Demonstration  of  the  Model  Assignment  Analysis  Technique 

This  section  of  the  report  describes  how  forecast  model  assignments  to  Item 
classes  were  designed  and  tested.  Model  assignment  Includes  the  study  of  the 
performance  of  any  one  over  a  hundred  Individual  models  to  the  more  difficult 
problem  of  the  Interaction  of  competing  models  in  a  group.  For  example,  if  two 
models  perform  the  same  on  most  Items,  It  Is  probably  feasible  to  assign  one. 
However,  If  two  models  perform  well  on  distinctly  different  Items,  their 
performance  as  a  group  will  be  considerably  enhanced. 

All  model  assignment  analysis  performance  statistics  are  relative  to  a  base 
model.  In  the  model  assignment  analyses  In  this  report,  the  base  model  was 
chosen  as  the  current  DLA  method.  For  demonstration  purposes,  the  model 
assignment  analysis  for  perishable  subsistence  is  described  here.  The  model 
assignment  analysis  for  semlperlshable  subsistence  is  provided  in  Appendix  D. 

The  final  model  assignment  analysis  report  for  perishable  subsistence  Is 
provided  for  demonstration  purposes.  The  model  assignment  report  contains  nine 
tables  which  are  used  to  construct  and  test  groups  of  forecast  models  for  the 
subsistence  commodity. 


Table  7  provides  the  input  specifications  for  the  model  assignment  analysis. 
Information  following  the  9  indicates  the  identification  of  the  test  under 
study.  FORECAST  file  indicates  the  Fortran  device  assigned  for  the  Input  file 
from  the  Model  Evaluation  Phase.  Model  TITLES  file  indicates  the  Fortran 
device  assigned  for  the  Model  Titles.  Select  Is  an  option  to  sort  on  brand 
name,  troop  issue,  or  not.  Post-forecast  Thell  adjustment  is  an  option 
selected  to  estimate  magnitude  of  improvement  when  unsatisfactory  models  are 
corrected  for  bias  and  regression  errors.  Random  residual  check  may  be  used  to 
constrain  model  assignment.  The  Base  Model  is  the  present  DLA  forecast 
formulation  or  whatever  other  model  the  user  may  choose.  The  performance  in 
the  test  set  of  all  model  assignments  will  be  made  relevant  to  the  base  model's 
performance.  The  CHI-Square  Limitation  may  be  used  to  provide  a  certain 
confidence  level  for  randomness  In  the  residuals. 


Table  7 
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MODEL  ASSIGNMENT  ANALYSIS  -  PERISHABLE  SUBSISTENCE: 
INPUT  SPECIFICATIONS 
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The  MODELS  ON  FILE  are  those  generated  from  the  identification  and  evaluation 
phase.  See  Appendix  N  for  formulas  and  acronyms.  The  Analyzed  models  are  the 
set  which  are  selected  to  be  assigned  across  the  class  of  items  under  study 
resulting  in  an  Improvement  or  degradation  in  performance  over  the  base  model. 

Table  8  demonstrates  the  assignment  occurrence  and  individual,  assignment 
distribution  matrices.  For  this  class  of  items  (perishable),  and  the 
predictive  period  (lead  time)  under  study,  the  assignment  occurrence  table 
provides  the  frequency  of  occurrence  of  the  best  and  second  best  model  in  terms 
of  RMSE  reduction.  Models  asterisked  are  those  assigned  in  the  analysis. 

For  example,  the  unanalyzed  model  3  -  (24^0  AVG)  was  better  240  times  than  the 
assigned  model  7  -  (SES(.15))  when  model  7  was  selected  best  (823  times). 

The  Prefer  row  indicates  how  often  each  unanalyzed  model  would  be  preferred  to 
any  of  the  assigned  models.  This  is  the  sum  of  the  columns  of  the  occurrence 
matrix. 

The  Accept  row  indicates  how  frequently  the  assigned  models  were  first  or 
second,  (e.g.,  2  times  the  ntsaber  of  series  being  tested).  The  assign  row 
indicates  the  best  assignment  among  the  analyzed  models. 

The  average  standard  deviation  index  is  the  sum  over  the  item  class  of  the 
ratio  of  assigned  model  RMSE  to  base  model  RMSE.  The  number  of  series  in  the 
item  class  is  also  noted.  The  individual  distribution  table  provides  the 
performance  distribution  in  deciles  from  -100  to  100  for  each  model  on  the  file 
when  individually  assigned  to  the  entire  class  of  items  under  study. 
Performance  Is  defined  as  the  average  percentage  reduction  in  RMSE  as  compared 
to  the  base  model.  For  the  example,  the  RMSE  of  model  3  (24-month  average)  was 
40  to  SOZ  less  than  RMSE  of  the  base  model  four  times  for  the  1993  series  under 
study.  At  the  same  time,  the  RMSE  of  model  3  was  40  to  50  percent  greater  than 
the  RMSE  of  the  base  model  17  times. 

The  first  matrix  on  Table  9  shows  the  performance  measured  by  lower  average 
ratios  of  assigned  model  RMSE  to  base  model  RMSE  of  individual  vs.  base  model 
when  each  model  is  individually  assigned  across  the  entire  class  of  items.  The 
second  row  of  this  matrix  Indicates  the  standard  deviation  about  the  mean  of 
the  Individual  performances.  The  third  row  of  this  matrix  provides  the  number 
of  standard  deviations  around  100  percent  wherein  the  mean  performance  lies , 
e.g.,  (  100  -  PERF  ).  The  second  matrix  of  Table  9  depicts  the  percentage  in 
STD 

base  RMSE  performance  distribution  In  deciles  from  -100  to  100  and  the 
reduction  In  Base  RMSE  for  assigned  model  to  the  subclass  where  they  are 
assigned.  For  example,  for  the  796  times  the  12-MO  average  model  was  assigned 
an  average  reduction  of  22  percent  In  RMSE  was  achieved  over  the  base  model  for 
those  796  demand  series. 

Table  10  provides  the  assignment  contribution  matrix  which  is  critical  to  the 
testing  of  the  assigned  group  of  models.  The  assignment  contribution  matrix  is 
a  tool  which  can  be  used  to  show  whether  additional  performance  may  be  gained 
by  adding  or  switching  models. 

In  the  study  of  the  assignment  contribution  it  is  important  to  remember  the 
distinction  between  the  assigned  and  unanalyzed  models  on  the  file. 
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MODEL  ASSIGNMENT  ANALYSIS  -  PERISHABLE  SUBSISTENCE: 
lead  time  demand  -  ASSIGNMENT  OCCURRENCE  AND 
INDIVIDUAL  ASSIGNMENT  DISTRIBUTION  MATRICES 
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MODEL  ASSIGNMENT  ANALYSIS  -  PERISHABLE  SUBSISTENCE: 
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The  first  column  of  the  matrix  in  Table  10  provides  the  model  number.  The 
second  column  contains  the  assignment  frequency  for  assigned  models  or  the 
frequency  which  the  unanalyzed  models  outperformed  any  In  the  assigned  group 
for  the  unanalyzed  models.  For  example,  796  times  out  of  1993,  model  2  (12 
month  average)  outperformed  any  In  the  assigned  group. 

The  third  column  provides  the  percentage  Improvement  In  base  RMSE  over  the 
assigned  group  for  the  unanalyzed  models  on  those  series  they  performed  better. 
For  models  in  the  assigned  group,  the  third  column  provides  the  average  loss  of 
performance  on  the  assigned  subclass  of  Items  If  the  model  were  deleted  from 
the  assigned  group. 

For  unanalyzed  models,  the  fourth  column  contains  the  additional  average 
performance  to  be  gained  across  the  entire  class  of  Items  if  the  unanalyzed 

model  were  added  to  the  subgroup.  For  assigned  models,  the  fourth  column 

contains  the  loss  of  performance  across  the  entire  class  of  Items  should  the 
models  be  deleted  from  the  group.  With  column  5,  the  assignment  switching 
matrix  (#  models  x  #  models)  begins.  The  purpose  of  the  assignment  switching 
matrix  Is  to  perform  sensitivity  analyses  on  the  selection  of  the  assigned 
model  group  with  at  most  two  models  at  a  time.  The  diagonal  of  the  assignment 
switching  matrix  Is  equivalent  to  column  4.  An  example  of  the  use  of  the 
assignment  switching  matrix  Is  as  follows: 

a.  Both  models  1  and  5  (global  mean  and  SES(.OS))  are  unanalyzed 

In  the  test  group.  Individually,  adding  model  I  would  provide  a  1.2  percent 
additional  reduction  In  RMSE  while  Individually,  model  5  could  add  1.1 

percent.  However,  the  additional  performance  (1.7  percent)  achieved  by 

Including  both  models  Is  not  additive.  This  Indicates  that  often  both  the 
global  mean  and  SES(.05)  perform  similarly  on  most  Items  which  Is  not 
surprising.  Performance  can  be  additive  when  the  two  models  perform  well  on 
distinctly  different  series. 

b.  Models  7  (SES(.l5))  and  19  (LAST  YEAR)  are  both  assigned.  If 
model  7  was  deleted  from  the  assigned  group,  a  1.6  percent  reduction  In 
performance  would  be  encountered.  If  model  19  was  deleted  from  the  group,  a 
.5  percent  reduction  Is  expected.  However,  when  both  are  deleted,  a  2.0 
percent  reduction  In  performance  would  be  encountered.  This  Indicates  that 
model  19  Is  performing  well  when  model  7  Isn't  and  that  the  effects  of  their 
deletion  Is  almost  additive. 

c.  Model  7  (SES(.IS))  Is  assigned,  however,  model  12  (DES(.20)) 
Is  not.  To  measure  the  effect  of  switching  models  7  and  12,  go  to  row  12, 
column  11,  of  the  assignment  contribution  matrix  (-1.4).  This  Indicates  that 
If  DES(.20)  were  substituted  for  SES(.15)  In  the  assigned  group,  a  degradation 
of  1.4  percent  In  performance  would  occur. 

d.  Models  18  and  19  are  known  as  naive  methods  and  require  no 
calculations.  In  the  model  assignments  In  this  study,  several  heuristics  were 
decided  upon  as  follows: 

(1)  Do  not  assign  long-term  moving  averages  or  global  mean 
due  to  data  storage  considerations  or  high  mean  bias. 

(2)  Assign  either  single,  double,  DLA  formulations,  and 
adaptive  exponential  smoothing  using  one  or  the  combined 
exponential  smoothing  model  but  not  both. 
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(3)  Do  not  employ  exponential  smoothing  with  two  distinct 
fixed  smoothing  constants  due  to  the  uncertainty  of  which  to 
use  in  the  future. 


(4)  Use  the  simple  naive  models  as  a  baseline  to  measure 
performance  due  to  ease  of  use.  In  forecasting  literature 
performance  is  often  measured  by  the  Theil  U  Statistic,  the 
ratio  of  the  RMSE  of  the  forecast  model  to  the  RMSE  of  no 
change  extrapolation  (Model  18). 

(5)  Use  the  simplest,  most  effective  nonnaive  seasonal  model 
available,  which  in  this  study  was  the  ARl  with  lag  seasonal 
term.  The  ARl  lag  is,  in  effect,  a  regression  using  a  naive 
monthly  and  the  last  year  forecasts  as  independent  variables. 

The  first  of  four  sections  of  Table  11  indicates  the  mean  bias  (e.g.,  Thell's 
bias  proportion  averaged  across  all  items)  and  the  standard  deviation  about  the 
mean  bias  for  individual  model  assignment.  Long-term  averages  such  as  model  1  - 
the  Global  mean  and  model  4  -  the  36-month  average  exhibit  high  mean  bias  as 
can  be  observed  here.  These  should  be  corrected  for  bias  prior  to  their  use. 

The  second  section  of  Table  11  provides  the  mean  bias  (e.g.,  Thell's  bias 
proportion  averaged  over  assigned  subclasses  for  each  assigned  model)  and  the 
standard  deviation  about  that  mean. 

The  third  section  of  Table  11  reflects  the  performance  distribution  of  the 
assigned  group  in  deciles. 

The  fourth  section  of  Table  II  indicates  the  future  performance  of  the  base 
model  against  the  assigned  set  or  the  amount  of  error  we  accept  using  the  base 
model  in  lieu  of  the  assigned  model  group.  The  entire  model  assignment 
analysis  is  repeated  for  procurement  cycle  demand  in  Tables  12  through  IS. 

Optimal  Linear  Corrections  and  corrections  for  mean  bias  require  the  storage  of 
extra  data  elements  to  perform  forecast  adjustments  as  do  Autoregressive 
Harmonic  Models.  Nonetheless,  based  on  the  heuristics  above,  the  assigned  set 
appears  optimal  for  perishable  subsistence  items. 

Assignment  of  the  forecast  models  may  be  made  individually  (e.g.,  simply 
replacement  of  present  method  by  another  or  by  a  group). 

Only  methods  that  resulted  in  significant  reduction  in  standard  deviation  of 
lead  time  and  procurement  cycle  demand  were  accepted  for  assignment.  If  a 
model  was  unacceptably  biased  (U">.2),  it  was  rejected.  However,  in  this 
case,  a  pre-correction  for  mean  bias  could  be  employed.  This  approach  would 
result  in  even  greater  reductions  in  standard  deviation  of  lead  time  and 
procurement  cycle  demand. 

2.  Construction  of  Model  Groups  for  the  Subsistence  Commodity. 

The  solution  of  the  model  assignment  problem  requires  a  procedure  to  rank  the 
competing  models  against  the  current  method  for  a  specified  group  of  items.  It 
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Table  11 

MODEL  ASSIGNMENT  ANALYSIS  -  PERISHABLE  SUBSISTENCE: 
LEAD  TIME  DEMAND  -  BIAS  AND  OVERALL 
PERFORMANCE  OF  GROUP  ASSIGNMENT 
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MODEL  ASSIGNMENT  ANALYSIS  -  PERISHABLE  SUBSISTENCE: 
PROCUREMENT  CYCLE  DEMAND  -  ASSIGNMENT  OCCURRENCE  AND 
INDIVIDUAL  ASSIGNMENT  DISTRIBUTION  MATRICES 
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is  necessary  to  test  Individual  model  assignments  across  the  entire  subsistence 
commodity  and  to  test  groups  of  competing  models  and  their  interactions.  The 
authors  designed  software  to  construct  a  group  of  models  for  any  set  of 
subsistence  items.  The  model  assignment  analysis  technique  will  be  used  to 
construct  various  model  groups  for  perishable  and  semi perishable  subsistence, 
respectively. 

Due  to  the  large  number  of  models  to  be  evaluated,  initial  screening  was 
necessary  to  develop  a  final  model  test  set  from  which  to  select  a  model  group. 
Fourteen  model  test  sets  are  described  in  Appendix  N.  There  was  only  a  3%  to 
SZ  variation  in  performance  (RMSE  reduction)  among  the  model  test  sets  when 
all  models  were  assigned.  Model  test  set  13  resulted  in  the  greatest  reduction 
in  RMSE.  Model  test  set  13  was  then  adjusted  to  determine  if  improvement  could 
be  achieved  by  the  addition  of  exponential  smoothing  techniques.  The  resultant 
test  set  contains  26  models  including  model  test  set  13  (the  harmonic  models 
were  dropped  out  of  Model  Test  Set  13  as  they  provided  little  or  no  additional 
improvement),  single,  double,  and  adaptive  exponential  smoothing  and  the 
COMBINED  model.  This  test . set  is  used  to  develop  model  groups  for  assignment 
to  subsistence  commodity  and  is  referenced  in  the  model  assignment  reports  as 
"MODELS  ON  FILr. 

The  construction  of  the  model  groups  for  the  perishable  and  semlperlshable  item 
classes  from  individual  to  final  group  will  now  be  described.  (Assignment  of 
the  forecast  models  may  be  made  individually  (e.g.,  simply  replace  the  present 
method  by  another)  or  as  a  group. 

Using  a  model  assignment  analysis  report,  the  performance  statistics  on  the 
five  best  individuals  models  for  perishable  and  semiperishable  subsistence  are 
derived.  These  performance  statistics  include  mean  reduction  in  RMSE,  standard 
deviation  about  the  mean  reduction  and  the  mean  bias.  Table  16  provides  these 
performance  statistics  for  the  five  best  individual  models. 


Table  16 


BEST  INDIVIDUAL  FORECAST  PERFORMANCES  FOR  THE  SUBSISTENCE  COMMODITY 


Subsistence  Category 


Perishable  SemlPerlshable 


Lead  Time  Demand 


Mean  Reduction 

Mean 

Mean 

Reduction 

Mean 

Model 

In 

RMSE 

Std  Dev 

Bias 

Model 

In 

RMSE 

Std  Dev 

Bias 

SES(.15) 

13.3 

12.0 

.058 

COMBINED 

8.2 

9.6 

.056 

SES(.20) 

13.1 

10.0 

.041 

SES(.15) 

5.6 

10.9 

.103 

COMBINED 

12.7 

10.4 

.028 

12  Mo  Avg 

5.2 

14.2 

.100 

SES(.25) 

12.4 

8.6 

.032 

SES(.20) 

4.2 

7.3 

.074 

12  Mo  Avg 

12.0 

15.7 

.059 

SES(.IO) 

3.0 

2a.  2 

.164 

Procurement  Cycle  Demand 

Mean 

Reduction 

Mean 

Mean 

Reduction 

Mean 

Model 

In 

RMSE 

Std  Dev 

Bias 

Model 

In 

RMSE 

Std  Dev 

Bias 

12  Mo  Avg 

11.3 

10.7 

.050 

COMBINED 

5.8 

7.6 

.064 

SES(.15) 

11.2 

7.9 

.048 

SES(.15) 

3.7 

8.1 

.098 

COMBINED 

11.0 

7.5 

.029 

12  Mo  Avg 

3.0 

9.9 

.095 

SES(.IO) 

11.0 

10.5 

.072 

SES(.IO) 

2.6 

13.8 

.140 

SES<.20) 

10.6 

6.5 

.036 

SES(.20) 

1.6 

5.6 

.078 

Figure  3  depicts  the  distribution  of  performance  for  the  best  Individual  model 
assignment,  SES(.15),  for  Perishable  Subsistence.  Note  that  while  this  method 
Is  often  not  the  best  for  Individual  series,  It  Is  a  solid  performer  that 
rarely  performs  poorly.  On  the  average.  In  terms  of  reduced  RMSE  related  to 
present  DLA  methods.  It  Is  the  best  of  the  models  tested  for  perishable  Items. 

Figure  4  provides  the  distribution  of  performance  for  the  best  Individual  model 
assignment  for  semlperlshable  subsistence,  COMBINED. 

The  best  Individual  model  provides  the  greatest  Improvement  In  forecast 
accuracy.  The  addition  of  other  models  results  In  marginally  decreasing 
Improvements  In  forecast  performance. 

The  Initial  model  In  the  recommended  group  Is  the  best  Individual  model.  The 
next  consideration  was  to  Include  the  naive  models.  The  naive  models,  LAST 
LT/PC,  represents  no  change  forecasts  from  the  last  predictive  period's  actual 
demand.  The  naive  model,  LAST  YEAR,  represents  no  change  forecasts  from  the 
actual  demand  last  year  during  the  same  period. 

The  naive  models  serve  as  benchmarks  In  a  forecasting  system  for  the  evaluation 
of  trends  and  seasonal  demand  patterns.  The  best  individual  and  two  naive 
models  are  designated  as  the  elementary  model  group. 

Appendix  D  contains  the  model  assignment  analyses  for  the  elementary  model 
groups.  Table  17  demonstrates  the  comparative  performance  of  the  elementary 
model  group  and  the  best  Individual  model.  The  Percent  Improved  columns  in 
Table  17  refers  to  the  percentage  of  demand  series  that  experienced  reduced 
RMSE  over  the  present  DLA  forecast  RMSE. 
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FIGURE  4 

PERFORMANCE  DISTRIBUTION  OF 
BEST  INDIVIDUAL  FORECAST  MODEL  -  COMBINED 
SEMIPERISHABLE  SUBSISTENCE 
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Table  17 


COMPARATIVE  PERFORMANCE  OF  BEST  INDIVIDUAL  AND 
ELEMENTARY  GROUPS  OF  FORECAST  MODELS 

Subsistence  Category 

Perishable  SemiPerishable 

Lead  Tine  Demand 

Mean  Reduction  Percent  Mean  Mean  Reduction  Percent  Mean 

Model  In  RMSE  Imprvd.  Bias  In  RMSE  Imprvd .  Bias 

Best 

Individual  13.3 

Elementary 
Group  15.4 


Mean  Reduction 
Model  In  RMSE 

Best 


Individual* 

11.3 

92.0 

.048 

5.8 

77.3 

.064 

Elementary 

Group 

12.0 

92.4 

.045 

6.6 

79.1 

.064 

*  12*^0  AVG  was  slightly  better  (.1  percent)  than  SES(.15)  for  procurement 
cycle  demand.  However,  In  the  interest  of  parsimony,  SES(.15)  Is  chosen  as 
best  Individual  model  since  It  achieved  less  dispersion  of  performance. 


Figures  5  and  6  depict  the  performance  distributions  of  the  elementary  model 
group  assignments,  for  Perishable  and  Semiperishable  Subsistence, 
respectively. 

Examination  of  the  model  assignment  analyses  in  Appendix  D  indicate  that 
additional  improvement  exceeding  a  1  percent  reduction  In  RMSE  can  be 
achieved.  However,  the  only  model  meeting  the  constraints  of  the  heuristics 
in  Section  IIIFI  is  the  12-MO  AVG.  For  example,  for  perishable  subsistence, 
model  1  -  GLOBAL  MEAN  and  model  3  -  24-MO  AVG,  are  eliminated  due  to  high  mean 
bias  and  data  storage  requirements  and  SES(.05)  Is  eliminated  due  to  borderline 
high  mean  bias  and  the  fact  that  model  7  -  SES(.15)  Is  already  assigned.  The 
same  rationale  holds  for  the  semlperlshable  model  assignment  analysis. 

Table  18  presents  the  comparative  performance  of  the  group  when  the  12-MO  AVG 
Is  added.  This  group  shall  be  designated  the  secondary  model  group. 
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FIGURE  6 

PERFORMANCE  DISTRIBUTION  OF  THE 
ELEMENTARY  MODEL  GROUP  - 
SEMIPERISHABLE  SUBSISTENCE 
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Table  18 


COMPARATIVE  PERFORMANCE  OF  BEST  INDIVIDUAL, 

ELEMENTARY,  AND  SECONDARY  GROUPS  OF  FORECAST  MODELS 

Subsistence  Category 

Perishable  SemlPerlshable 

Lead  Time  Demand 

Mean  Reduction  Percent  Mean  Mean  Reduction  Percent  Mean 

Model  In  RMSE  Imprvd ♦  Bias  In  RMSE  Imprvd .  Bias 

Best 

Individual  13.3  88.5  .058  8.2  82.2  .056 

Elementary 

Group  15.4  92.0  .049  10.1  84.7  .063 

Secondary 

Group  16.4  92.2  .050  11.6  88.2  .071 


Mean 

Bias 


.064 

.064 

.074 


Figures  7  and  8  depict  the  performance  distributions  of  the  secondary  model 
group  assignments,  for  Perishable  and  Semiperlshable  Subsistence,  respectively. 

Appendix  E  contains  the  model  assignment  analyses  for  the  secondary  model 
group . 

Examination  of  the  model  assignment  analyses  in  Appendix  E  indicate  that 
improvements  in  forecast  accuracy  exceeding  .75  percent  could  be  achieved, 
within  the  constraints  of  the  heuristics  in  Section  IIIFl,  only  by  the  addition 
of  an  autoregressive  seasonal  model.  Model  25  -  SARI  Lag  and  Model  21  -  ARl 
Lag  are  candidates.  Model  25  performs  slightly  better  than  Model  21  for  lead 
time  demand  while  Model  21  performs  even  more  better  than  Model  25  for 
procurement  cycle  demand.  Due  to  this  fact  and  in  the  interest  of  parsimony. 
Model  21  was  added  to  the  secondary  group  of  models  In  Appendix  E.  At  this 
point,  we  have  reached  the  point  of  diminishing  returns  within  the  constraints 
of  the  heuristics  in  Section  IIIFl.  The  groups,  derived  from  the  addition  of 
the  ARI  Lag  Seasonal  Model,  to  the  Secondary  groups,  will  be  designated  as  the 
Final  Model  Groups. 
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Imprvd . 
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Individual  11.3 

Elementary 
Group  12.0 
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Table  19  depicts  the  performance  of  the  final  model  groups  for  the 
Subsistence  Commodity. 


LEAD  77Atf’ 
DEMAND 


PROCUREMENT 

CYCLE 

DEMAND 


FIGURE  8 

PERFORMANCE  DISTRIBUTION  OF  THE 
SECONDARY  MODEL  GROUP  - 
SEMIPERISHABLE  SUBSISTENCE 
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Table  19 


PERFORMANCE  OF  THE  FINAL  MODEL  GROUPS 
FOR  THE  SUBSISTENCE  COMMODITY 


Subsistence  Category 

Perishable 

Semlperlshable 

Lead  Time 

Demand 

12-MO  AVG,  SES(.15), 

12 -MO  AVG,  COMBINED 

Last  LT,  Last  Year, 

Last  LT,  Last  Year, 

Group 

ARl  Lag 

ARl  Lag 

Mean  Reduction 

16.8 

12.4 

In  RMSE 

Percent  Improved 

93.5 

90.4 

Mean  Bias 

.047 

.068 

%  Error  Accepted 

22.7 

16.5 

Using  Present 

Methods 

Procurement  Cycle  Demand 

12-MO  AVG,  SES(.15), 

12-MO  AVG,  COMBINED, 

Last  PC,  Last  Year, 

Last  PC,  Last  Year, 

Group 

ARl  Lag 

ARl  Lag 

Mean  Reduction 

13.4 

8.3 

In  RMSE 

Percent  Improved 

93.1 

86.1 

Mean  Bias 

.043 

.065 

%  Error  Accepted 

17.1 

10.2 

Using  Present 
Methods 


Figures  9  and  10  depict  the  perfonsance  distributions  of  the  final  model  group 
assignments,  for  Perishable  and  Semiperishable  Subsistence,  respectively. 

Figure  11  provides  a  comparison  of  the  performance  of  the  best  Individual, 
elementary,  secondary  and  final  model  groups  for  perishable  and  semlperlshable 
subsistence,  respectively. 

3.  Model  Assignments  and  Item  Characteristics 

The  assignment  of  the  final  model  group  differed  by  Item  characteristic.  This 
section  of  the  report  highlights  variations  In  the  assignment  and  performance 
of  the  final  model  group  by  the  following  characteristics: 

(1)  Item  Category  -  Troop  Issue  vs.  Brand  Name 

(2)  Lead  Time  and  Procurement  Cycle  Duration 
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FIGURE  11 

COMPARISON  OF  FORECAST  MODEL  GROUP  PERFORMANCE 
FOR  THE  SUBSISTENCE  COMMODITY 
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Variations  in  Model  assignment  by  item  characteristics  are  Important  in 
designing  decision  rules  for  model  assignments  to  new  items. 


Tables  20  and  21  provide  the  frequency  of  occurrence  of  the  recommended  model 
group  assignments  by  item  category  (troop  issue  vs  brand  name)  for  perishable 
and  semlperlshable  subsistence,  respectively.  The  final  Model  Group  is 
split  into  Nonseasonal  and  Seasonal  components  for  comparative  purposes. 

Table  20 

FREQUENCY  OF  FINAL  MODEL  GROUP  ASSIGNMENT  BY 
ITEM  CATEGORY;  PERISHABLE  SUBSISTENCE 

Lead  Time  Demand 


ITEM  CATEGORY 

X  of  Total 
Perishable  Sample 

Mean  Reduction 
in  RMSE 

Percent 

Improved 

TROOP  ISSUE 

Nonseasonal 

64.2 

17.4 

95.9 

Seasonal 

4.9 

23.5 

94.8 

Total 

69.1 

17.9 

95.5 

BRAND  NAME 

Nonseasonal 

25.4 

13.7 

88.5 

Seasonal 

5.5 

17.5 

91.7 

Total 

30.9 

14.4 

89.1 

Procurement 

Cycle  Demand 

TROOP  ISSUE 

Nonseasonal 

65.3 

12.2 

92.7 

Seasonal 

3.8 

19.9 

85.7 

Total 

69.1 

12.5 

92.3 

BRAND  NAME 

Nonseasonal 

27.3 

13.0 

94.5 

Seasonal 

3.6 

21.5 

97.2 

Total 

30.9 

15.5 

94.8 

58 


Table  21 


FREQUENCY  OF  FINAL  MODEL  GROUP  ASSIGNMENT  BY 
ITEM  CATEGORY:  SEMIPERISHABLE  SUBSISTENCE 


Lead  Time  Demand 


ITEM  CATEGORY 

X  of  Total 
Perishable  Sample 

Mean  Reduction 
in  RMSE 

Percent 

Improved 

TROOP  ISSUE 

Nonseasonal 

49.8 

13.6 

95.7 

Seasonal 

7.8 

31.4 

100.0 

Total 

57.6 

16.0 

96.3 

BRAND  NAME 

Nonseasonal 

31.9 

5.7 

79.1 

Seasonal 

10.5 

13.2 

92.1 

Total 

42.4 

7.5 

82.3 

Procurement 

Cycle  Demand 

TROOP  ISSUE 

Nonseasonal 

51.4 

10.6 

92.6 

Seasonal 

6.2 

16.8 

98.3 

Total 

57.6 

11.3 

93.3 

BRAND  NAME 

Nonseasonal 

36.8 

3.5 

74.1 

Seasonal 

5.6 

9.7 

90.8 

Total 

42.4 

4.3 

76.3 

Tables  20  and  21  Indicate  that  Seasonal  Models  generally  provide  from  27  to 
277Z  better  forecasts  than  their  nonseasonal  counterparts  on  their  assigned 
subclasses.  This  is  not  surprising  as  the  present  DLA  forecast  does  not 
consider  seasonal  patterns.  Also,  forecast  performance  for  Che  troop  issue 
category  exceeded  chat  for  brand  name,  with  the  exception  of  procurement  cycle 
demand  for  perishable  items.  Seasonality  is  most  prevalent  In  the 
Semlperlshable  brand  name  category  (25%)  yet  rare  in  Che  Perishable  troop  issue 
area  (7Z). 


Tables  22  and  23  Indicate  that  seasonality  is  most  prevalent  at  lead  times  of 
four  months  for  the  perishable  class  and  five  months  for  the  semiperishable 
class . 

Figure  12  highlights  the  distribution  assignments  of  the  seasonal  component  of 
the  final  model  group  for  the  subsistence  commodity. 

Table  22 

FREQUENCY  OF  FINAL  MODEL  GROUP  ASSIGNMENTS  BY  LEADTIME  DURATION 

Perishable  Subsistence 


Z  of  Total  Z  of  Items  Assigned  to  Model  Type 

LT  Duration  Perishable  Sample  Nonseaaonal  Seasonal 
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FIGURE  12 

FREQUENCY  OF  OCCURRENCE  OF  DEMAND 
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Two  Stage  Forecasting.  The  authors  tested  two  stage  forecasting 
discussed.  In  Appendix  C,  where  the  forecast  are  adjusted  for  patterns  In  the 
errors.  The  results  were  prosdslng,  however,  the  technique  can  not  be  applied 
Indiscriminately.  When  applied  across  all  perishable  Items  the  adjusted 
forecasts  were  less  accurate  than  the  unadjusted  forecasts.  However,  for  many 
series  the  adjusted  forecasts  achieved  30  to  50Z  Improvement  over  the 
unadjusted  forecasts.  No  conclusions  can  be  drawn  without  further  study.  The 
benefits  of  Two  Stage  Forecasting  must  be  weighed  against  the  additional  data 
storage  costs  incurred.  Properly  applied,  it  may  well  be  a  valid  means  to 
achieve  Improved  forecasting. 

IV.  A  PROTOTYPE  SUBSISTENCE  DEMAND  FORECASTING  SYSTEM 
A.  Design  of  the  Forecasting  System 


This  section  of  the  report  describes  the  design  of  a  prototype  subsistence 
demand  forecasting  system  based  on  the  forecast  model  groups  developed  In 
Section  III. 


The  subsistence  demand  forecasting  system  must  generate  a  wide  range  of 
forecasts  to  Include: 

1.  Fixed  Forecasts  (e.g..  Service  Requirements,  Provisioning) 

2.  Forecast  Models  with  Fixed  Parameters  (e.g.,  SES(.20)) 

3.  A  procedure  to  switch  parameters  and  model  type  measure  within 
the  system  based  on  a  performance 

The  forecasting  models  in  the  system  will  be  based  on  the  final  model  groups  in 
Section  III  with  the  exception  that  SES(.20)  will  be  substituted  for  SES(.IS) 
for  perishable  subsistence.  The  models  which  generate  forecasts  in  the  system 
are  as  follows: 

12-MO  AVG  OLA(.20) 

SES(.IO)  DLA(.30) 

SES(.20)  LAST  LT/PC 

SES(.30)  LAST  YEAR 

DLA(.IO)*  ARl  LAG 

Figure  13  depicts  a  schematic  diagram  of  a  prototype  subsistence  demand 
forecasting  system. 

A  description  of  each  component  of  the  system  follows: 

1.  Demand  History  -  DPSC  presently  has  over  100  months  of 
subsistence  demand  history  available.  Forty-eight  (48)  months  of 
demand  history  are  required  to  initlllze  the  forecasting  system. 

The  most  recent  24  months  of  demand  history  should  be  maintained 
on-line  to  compute  the  two  naive  forecasts  and  the  12-MO  AVG 
forecast.  Each  month  as  a  new  demand  is  received,  the  on-line  and 
off-line  history  files  are  updated. 

2.  Forecast  Processor  -  The  function  of  the  forecast  processor  is  to 
provide  a  forecast  of  the  Item/warehouse  deswnd  over  the  next  lead 
time  and  procurement  cycle.  The  forecast  processor  is  divided  into 
three  subsystems  as  follows: 

a.  Forecast  Generator, 

b.  Forecast  History,  and 

c.  Forecast  Control. 

The  function  of  the  forecast  generator  is  to  develop  candidate  forecasts  for 
the  next  lead  time  and  procurement  cycle  demand. 


*  The  DLA  formula,  is  characterized  as  the  one-month-ahead  double  exponential 
smoothed  forecast  multiplied  by  the  lead  time  or  procurement  cycle  in  months 
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The  following  values  are  stored  In  the  Forecast  Generator  to  develop  forecasts 
for  single  exponential  smoothing,  the  DLA  formulation  and  the  ARl  Lag  Model: 

The  Single  Smoothed  Average  of  Monthly  Demands 

S^(.l),  S^(.2),  S^(.3) 


Summations  to  Compute  ARl  Lag  Forecast 


^(pLM)2  £  (pLY)2^  I  I  F^ACT,  I  F^^ACT 


where:  F^  *  Naive  Monthly  Forecast  (l.e.,  current  month's  demand) 

TV 

F  ■  Naive  Last  Year  Forecast 

ACT  *  Actual  Demand  over  Lead  Time  or  Procurement  Cycle 

T.  m  Summation  over  the  number  of  periods  of  historical  demand  which 
are  maintained 


Suppose  S  is  an  item  with  a  lead  time  of  5  months  and  procurement  cycle  of  3 
months.  Let  X^2>  *  *  •  >  X2  be  the  most  recent  11  months  of  on-*llne  demand 
history  and  let  be  the  current  month's  demand. 

The  ARl  LAG  lead  time  demand  forecast  Is  generated  solving  the  following 
equations  for  a^^  and  a2: 

«1  (F^)^  +  82  -  (ACT)F^ 

a^  +  82  <F^^)2  -  (aCT)F^^ 

using  their  values  stored  on  the  file  and  the  current  month's  demand.  The  next 
ARl  LAG  lead  time  deisand  forecast  is: 


■  Sj  Xj^  +  82  (^^2  ^11  ^  ^10  ^  ^  ^  ^8^ 

The  five  suamatlons  are  updated  and  stored. 

When  the  current  month's  demand  Is  recorded,  the  single  and  double  smoothed 
averages  are  updated  by  the  formulae: 

New  S^(ot)  -  04  Xj^  +  (1  -*)  S^(oe) 

New  s2(«4)  -  X  (New  Sl(x))  +  (l  -x)  s2(o4) 


65 


and  stored.  The  single  and  DLA  formulations  are  then  generated,  for  example: 
«  LT  *  [NEW  S^((j6] 


-  LT  *f(2  +  <^  )  NEW  S^U)  -  (1  +  ^  )  NEW  s2(;0] 

17Z 

The  24  months  of  on-line  demand  history  are  used  to  generate  the  12  month 
average  and  naive  forecasts. 
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The  Forecast  History  File  provides  a  holding  area  for  forecasts  to  be  used  In 
future  forecast  control.  The  ten  forecasts: 

pl2^0  AVG^  pSES(o»«)^  pDLA(0O^  pLAST  YEAR^  pLAST  LT/PC  pLAG 
where:  oL  -  .1,  .2,  .3 

for  both  lead  time  and  procurement  cycle  are  stored  In  the  Forecast  History 
File  until  the  actual  lead  time  and  procurement  cycle  errors  can  be 
calculated.  For  example,  when  the  actual  lead  time  demand  becomes  available, 
the  ABSOLUTE  ERROR|^jq  -  I  “  ^LTD  ^  computed  and  passed  to  the 

Forecast  Control  File  for  the  ten  models. 

The  Forecast  Control  Processor  Is  used  to  control  the  forecast  selection 
process  and  provide  an  estimate  for  the  standard  deviation  of  lead  time 
demand . 

In  Section  III,  tracking  In  the  COMBINED  model  based  on  the  smoothed  MAD  of  .2, 
delivered  the  best  forecast  performance.  The  smoothed  MAD  of  .2  is  defined  as 


the  single  exponentially  smoothed  average  (a<>.2)  of  the  absolute  errors.  The 
smoothed  MAD  will  be  denoted  as  SMA0(.2)  and  Is  defined  recursively  by: 


NEW  SMAD(.2)  -  (.2) [NEW  ABS(ERROR)]  +  .8  [OLD  SMAD(.2)] 

Due  to  Its  fine  performance  In  controlling  the  COMBINED  model  In  Section  III, 
the  SMAD(.2)  method  Is  recommended  as  the  performance  criteria  for  forecast 
selection  within  the  Forecast  Control  Processor.  The  ten  values  stored  In  the 
Forecast  Control  Processor  are  as  follows: 

Model  Control  Parameter 

12-MO  AVG  i^SMAD(.2) 

SES(.l)  ^SMAD(.2) 

SES(.2)  ^SMAD(.2) 

SES(.3)  ^SMAD(.2) 

DLA(.l)  ^SMAD(.2) 

DLA(.2)  ®SMAD(.2,) 

DLA(.3)  ^SMAD(.2) 

LAST  LT/PC  ®SMAD(.2) 

LAST  YEAR  'SMAD(.2) 

ARl  LAG  ^°SMAD(.2) 

Each  month,  as  a  new  absolute  error  Is  passed  to  the  Forecast  Control 
Processor,  the  SMAD's  are  updated  and  the  forecast  with  the  least  SMAD  Is 
chosen  as  the  forecast  for  the  next  lead  time  or  procurement  cycle  demand.  An 
estimate  for  the  standard  deviation  of  lead  time  demand  must  be  computed  and  Is 
given  by  1.25  *  SMAD(.2)  for  the  chosen  model. 

B.  System  Initialization .  Initialization  of  the  system  Is  necessary 
to  provide  Initial  values  for  the  exponential  smoothing  and  ARl  Lag  model  of 
the  monthly  demands  and  of  the  absolute  errors.  Inltllizatlon  Involves  the  use 
of  the  off-line  data  base.  Suppose  that  Initialization  Is  to  begin  at  time  t. 
For  the  range  of  smooching  constants  employed  In  the  system,  the  arithmetic 
average  of  the  monthly  demands,  13  Co  24  mouths  ago,  will  serve  as  an  Initial 
value.  The  arithmetic  average  of  Che  absolute  errors,  1  to  12  months  ago,  will 
serve  as  an  Initial  value  for  Che  SMAD  calculation.  Monthly  demands  from  month 
48  through  13  should  be  used  to  develop  Che  summations  for  the  ARl  LAG 
calculations.  The  arithmetic  average,  1  to  12  months  ago,  can  serve  as  Che 
Initial  value  for  Che  12-MO  AVG,  and  naive  models. 


C. 

Commodity 
commodity . 


Decision  Rules  for  Forecast  Model  Assignments  to  the  Subsistence 
.  Table  24  provides  the  model  assignments  for  the  subsistence 
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Table  24 

DECISION  RULES  FOR  FORECAST  MODEL  ASSIGNMENTS  TO 


ITEM  GROUPS  IN  THE  SUBSISTENCE  COMMODITY 


Established  Items 


Perishable  |  Semlperlshable  | 


Appendix  J 


Listing  Sorted 
by  Stock  Number 


Appendix  K 


Item  Groups 
Sorted  by  Model 
Assignment 


Appendix  L 


Listing  Sorted 
by  Stock  Number 


Appendix  H 


Item  Groups 
Sorted  by  Model 
Assignment 


I 


New  Items 


-  24  Months 

Service  Requirement 
(Fixed  Forecast) 


24  Months  and  Older 


Perishable 

Initially  SES(.2)r 
then,  switch  I 
between  all  I 

models  In  fore-  | 
cast  system  based | 
on  smoothed  MAD  | 

(.2).  I 


Semlperlshable 


Initially  SES(.2) 
then,  switch 
between  all 
models  In  fore¬ 
cast  system  based 
on  smoothed  MAD 
(.2). 


Implementation  Considerations 


The  subsistence  demand  forecasting  system  must  provide  lead  time  and 
procurement  cycle  demand  forecasts  for  about  4,000  Item/warehouse  records  each 
month.  The  monthly  updates  can  easily  be  run  on  DPSC  mainframe  computers 
within  a  4-hour  period.  With  modern  breakthroughs  In  data  storage  and 
retrieval,  the  Forecasting  System  Storage  Requirement  Is  minimal,  at  worse. 

The  Forecast  System  provides  DLA  with  the  capability  to  Identify,  compare,  and 
evaluate  the  various  demand  patterns  encountered  in  the  subsistence  commodity. 
It  also  controls  the  demand  forecasts  when  the  demand  pattern  changes. 

V.  CONCLUSIONS  AND  RECOMMENDATIONS 


Conclusions 

0  Seasonality  Is  an  Important  factor  In  subsistence  demand  forecas 


ting  .  Seasonality  of  lead  time  demand  occurs  about  14Z  of  the  time  for 
centrally  stocked  Subsistence  items.  Seasonality  Is  more  prevalent  In  the 
semlperlshable  (181)  versus  perishable  (lOZ)  category.  Improvements  In 
forecast  accuracy  were  generally  much  greater  for  items  with  seasonal  patterns 
than  for  those  with  nonseasonal  patterns  (Tables  20  and  21). 

o  Demand  forecasting  for  nonseasonal  subsistence  items  can  be  signi¬ 
ficantly  Improved  .  Although  the  larger  reduction  in  forecast  error  can  be 
achieved  for  seasonal  Items,  a  reduction  can  also  be  achieved  for  nonseasonal 
Items  (Tables  20  and  21).  The  nonseasonal  component  of  the  Final  Model  group 


m 
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reduced  forecast  error  (measured  by  RMSE)  by  14,7%  over  the  lead  time  and  11.6% 
over  the  procurement  cycle  for  nonseasonal  perishable  items.  For  nonseasonal 
semi perishable  items,  the  reductions  were  8.6%  and  6,7%,  respectively. 

o  Reduction  in  safety  levels  and  "stockout  cost”  are  possible  . 
Reductions  in  the  standard  deviation  of  lead  time  demand  will  surely  reduce  the 
safety  level  stock  held  for  subsistence  recently  valued  at  around  $95  million 
(end  FY  84).  Also  the  costs  of  ’’stockout",  both  tangible  such  as  special 
processing  and  impact  on  substitute  item  demand  and  intangible,  such  as 
customer  satisfaction,  will  be  more  easily  managed. 

o  A  Forecasting  System  based  on  a  group  of  models  tested  in  this 
study  can  identify,  compare,  evaluate,  and  control  subsistence  demand 
patterns  .  Section  IV  describes  a  prototype  forecasting  system  for  the 
subsistence  commodity.  This  system  is  based  on  a  blend  of  theoretical  and 
practical  considerations.  The  system  is  designed  to  provide  fixed  forecasts, 
forecasts  based  on  models  with  fixed  parameters,  and  forecasts  selected  by 
performance  measure.  The  system  is  relatively  simple  and  easy  to  implement. 

B.  Recommendations 


o  The  Executive  Director  for  the  Directorate  of  Supply 
Operations  should  take  the  following  actions  as  a  result  of  this  study: 

oo  Direct  that  the  prototype  Forecasting  System  designed  in 
this  report  be  used  as  the  basis  for  the  Functional  Description  under  the 
Defense  Integrated  Subsistence  Management  System  (DISMS).  Identity  resources 
for  the  purposes  of  implementation  and  monitor  performance. 

oo  Direct  the  incorporation  of  the  prototype  Forecasting 
System  into  the  exlstins  subsistence  requirements  computation  system.  This 
would  serve  as  an  independent  validation  of  the  Forecasting  System  and  lend 
credence  to  its  implementation  into  DISMS. 

oo  Direct  the  computer  software  generated  in  the  design  of 
the  Forecasting  System  by  maintained  by  DISMS  for  future  use. 


